Sep 29 16:25:23 devstack cinder-volume[75835]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 16:25:23 devstack cinder-volume[75835]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 16:25:23 devstack cinder-volume[75835]: we strongly recommend against using it for new projects. Sep 29 16:25:23 devstack cinder-volume[75835]: If you are already using Eventlet, we recommend migrating to a different Sep 29 16:25:23 devstack cinder-volume[75835]: framework. For more detail see Sep 29 16:25:23 devstack cinder-volume[75835]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 16:25:23 devstack cinder-volume[75835]: import eventlet # noqa Sep 29 16:25:26 devstack cinder-volume[75835]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 16:25:26 devstack cinder-volume[75835]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 16:25:26 devstack cinder-volume[75835]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 16:25:27 devstack cinder-volume[75835]: INFO dbcounter [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Registered counter for database cinder Sep 29 16:25:27 devstack cinder-volume[75835]: DEBUG oslo_db.sqlalchemy.engines [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 16:25:27 devstack cinder-volume[75835]: DEBUG dbcounter [-] [75835] Writer thread running {{(pid=75835) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 16:25:27 devstack cinder-volume[75835]: INFO cinder.rpc [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 16:25:27 devstack cinder-volume[75835]: INFO cinder.rpc [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 16:25:27 devstack cinder-volume[75835]: DEBUG oslo_db.sqlalchemy.engines [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 16:25:27 devstack cinder-volume[75835]: INFO cinder.volume.manager [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Determined volume DB was empty at startup. Sep 29 16:25:27 devstack cinder-volume[75835]: DEBUG cinder.volume.manager [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75835) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 29 16:25:27 devstack cinder-volume[75835]: INFO cinder.volume.manager [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 29 16:25:27 devstack cinder-volume[75835]: WARNING stevedore.named [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 16:25:27 devstack cinder-volume[75835]: WARNING castellan.key_manager [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 16:25:27 devstack cinder-volume[75835]: WARNING cinder.keymgr.conf_key_mgr [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 16:25:27 devstack cinder-volume[75835]: DEBUG cinder.volume.drivers.lvm [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75835) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 29 16:25:27 devstack cinder-volume[75835]: DEBUG oslo_concurrency.processutils [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_concurrency.processutils [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] CMD "cinder-rtstool verify" returned: 0 in 0.436s {{(pid=75835) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_db.sqlalchemy.engines [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 16:25:28 devstack cinder-volume[75835]: INFO cinder.rpc [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 29 16:25:28 devstack cinder-volume[75835]: INFO cinder.rpc [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 29 16:25:28 devstack cinder-volume[75835]: WARNING stevedore.named [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 16:25:28 devstack cinder-volume[75835]: WARNING castellan.key_manager [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 16:25:28 devstack cinder-volume[75835]: INFO cinder.volume.manager [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_db.sqlalchemy.engines [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75835) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 16:25:28 devstack cinder-volume[75835]: INFO oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Starting 1 workers Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Started child 75981 {{(pid=75835) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Full set of CONF: {{(pid=75835) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] ******************************************************************************** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Configuration options gathered from: {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] ================================================================================ {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] allow_availability_zone_fallback = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] allow_compression_on_image_upload = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] allowed_direct_url_schemes = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] api_rate_limit = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] auth_strategy = keystone {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] az_cache_duration = 3600 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_availability_zone = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_host = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_stats_polling_interval = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backup_api_class = cinder.backup.api.API {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backup_name_template = backup-%s {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backup_use_same_host = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backup_use_temp_snapshot = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] chap_password = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] chap_username = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cinder_internal_tenant_project_id = 3bbd32baa9714dc7b4bc477b57b1de03 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cinder_internal_tenant_user_id = fd7fda817c5f40ba8f0892cae5832dfd {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cloned_volume_same_az = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cluster = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75981]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] compression_format = gzip {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] compute_api_class = cinder.compute.nova.API {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] config_dir = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] config_source = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] control_exchange = openstack {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] debug = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] default_availability_zone = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] default_group_type = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] default_volume_type = lvmdriver-1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] disk_geometry = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] driver_client_cert = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] driver_client_cert_key = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] driver_data_namespace = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] driver_ssl_cert_path = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] driver_ssl_cert_verify = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] driver_use_ssl = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] enable_force_upload = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] enable_new_services = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] enable_unsupported_driver = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] enforce_multipath_for_image_xfer = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] filter_function = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance_api_insecure = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance_api_servers = ['http://192.168.122.156/image'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance_api_ssl_compression = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance_ca_certificates_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance_catalog_info = image:glance:publicURL {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance_certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance_keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance_num_retries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance_request_timeout = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] goodness_function = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] graceful_shutdown_timeout = 5 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] group_api_class = cinder.group.api.API {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] host = devstack {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] image_compress_on_upload = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] image_conversion_address_space_limit = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] image_conversion_cpu_limit = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] image_conversion_disable = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] image_introspection_address_space_limit = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] image_introspection_cpu_limit = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] image_upload_use_cinder_backend = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] image_upload_use_internal_tenant = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] image_volume_cache_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] image_volume_cache_max_count = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] image_volume_cache_max_size_gb = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] init_host_max_objects_retrieval = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] instance_format = [instance: %(uuid)s] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] iscsi_target_flags = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] iscsi_write_cache = on {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] iser_helper = tgtadm {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] iser_ip_address = 192.168.122.156 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] iser_port = 3260 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] log_color = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] log_config_append = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] log_dir = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] log_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] log_options = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] log_rotate_interval = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] log_rotate_interval_type = days {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] log_rotation_type = none {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] max_age = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] max_logfile_count = 30 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] max_logfile_size_mb = 200 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] max_over_subscription_ratio = 20.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] message_reap_interval = 86400 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] message_ttl = 2592000 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] migration_create_volume_timeout_secs = 300 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] monkey_patch = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] monkey_patch_modules = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] my_ip = 192.168.122.156 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] no_snapshot_gb_quota = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] num_iser_scan_tries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] num_shell_tries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] num_volume_device_scan_tries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] nvmeof_conn_info_version = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] nvmet_ns_id = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] nvmet_port_id = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] osapi_max_limit = 1000 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] osapi_volume_ext_list = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] osapi_volume_listen_port = 8776 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] osapi_volume_use_ssl = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] osapi_volume_workers = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] per_volume_size_limit = -1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] periodic_fuzzy_delay = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] periodic_interval = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] public_endpoint = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] publish_errors = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] quota_backup_gigabytes = 1000 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] quota_backups = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] quota_gigabytes = 1000 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] quota_groups = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] quota_snapshots = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] quota_volumes = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] rate_limit_burst = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] rate_limit_except_level = CRITICAL {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] rate_limit_interval = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] reinit_driver_count = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] replication_device = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] report_discard_supported = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] report_interval = 120 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] reservation_clean_interval = 86400 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] reservation_expire = 86400 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] reserved_image_namespaces = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] reserved_percentage = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] rpc_response_timeout = 120 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] run_external_periodic_tasks = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] scst_target_driver = iscsi {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] scst_target_iqn_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] service_down_time = 720 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] shell_completion = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] snapshot_name_template = snapshot-%s {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] snapshot_same_host = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] split_loggers = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] state_path = /opt/stack/data/cinder {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] storage_availability_zone = nova {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] storage_protocol = iSCSI {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] syslog_log_facility = LOG_USER {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75981]: INFO cinder.volume.manager [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] target_helper = lioadm {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] target_ip_address = 192.168.122.156 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] target_port = 3260 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] target_protocol = iscsi {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] target_secondary_ip_addresses = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] trace_flags = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] transport_url = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] until_refresh = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] use_chap_auth = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] use_default_quota_class = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] use_journal = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] use_json = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] use_multipath_for_image_xfer = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] use_stderr = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] use_syslog = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] verify_glance_signatures = enabled {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] volume_api_class = cinder.volume.api.API {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] volume_backend_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] volume_clear = zero {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] volume_clear_ionice = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] volume_clear_size = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] volume_copy_bps_limit = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] volume_dd_blocksize = 1M {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] volume_name_template = volume-%s {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] volume_service_inithost_offload = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] volume_usage_audit_period = month {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] zoning_mode = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_concurrency.disable_process_locking = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.auth_section = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.auth_type = password {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.auth_version = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.cache = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.include_service_catalog = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.insecure = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.interface = public {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_password = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcache_username = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.region_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.service_type = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.156/identity {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.backend = dogpile.cache.null {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.backend_argument = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.backend_expiration_time = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.config_prefix = cache.oslo {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.debug_cache_backend = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.enable_retry_client = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.enable_socket_keepalive = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.expiration_time = 600 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.hashclient_retry_attempts = 2 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.memcache_dead_retry = 300 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.memcache_pool_maxsize = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.memcache_sasl_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.password = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.proxies = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.redis_db = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.redis_server = localhost:6379 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.retry_attempts = 2 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.retry_delay = 0.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.socket_keepalive_count = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.socket_keepalive_idle = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.socket_keepalive_interval = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.socket_timeout = 1.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.tls_allowed_ciphers = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.tls_cafile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.tls_certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.tls_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.tls_keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cache.username = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] coordination.backend_url = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.asyncio_connection = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.asyncio_slave_connection = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.backend = sqlalchemy {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.connection = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.connection_debug = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.connection_parameters = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.connection_recycle_time = 3600 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.connection_trace = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.db_inc_retry_interval = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack sudo[75985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.db_max_retries = 20 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.db_max_retry_interval = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.db_retry_interval = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.max_overflow = 50 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.max_pool_size = 5 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.max_retries = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.mysql_wsrep_sync_wait = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.pool_timeout = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.retry_interval = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.slave_connection = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack sudo[75985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.sqlite_synchronous = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.synchronous_reader = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] database.use_db_reconnect = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_tracing.insecure = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] profiler.connection_string = messaging:// {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] profiler.enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] profiler.es_doc_type = notification {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] profiler.es_scroll_size = 10000 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] profiler.es_scroll_time = 2m {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] profiler.filter_error_trace = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] profiler.hmac_keys = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] profiler.sentinel_service_name = mymaster {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] profiler.socket_timeout = 0.1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] profiler.trace_requests = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] profiler.trace_sqlalchemy = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] profiler_jaeger.process_tags = {} {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] profiler_jaeger.service_name_prefix = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] profiler_otlp.service_name_prefix = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_policy.enforce_new_defaults = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_policy.policy_default_rule = default {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_policy.policy_file = policy.yaml {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] privsep_osbrick.group = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] privsep_osbrick.helper_command = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] privsep_osbrick.user = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cinder_sys_admin.group = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cinder_sys_admin.helper_command = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] cinder_sys_admin.user = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] service_user.auth_section = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] service_user.auth_type = password {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] service_user.cafile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] service_user.certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] service_user.collect_timing = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] service_user.insecure = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] service_user.keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] service_user.send_service_user_token = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] service_user.split_loggers = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] service_user.timeout = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] service_user.tls_ciphers = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] service_user.tls_min_version = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance.auth_section = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance.auth_type = password {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance.certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance.collect_timing = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance.insecure = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance.keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance.region_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance.split_loggers = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance.timeout = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance.tls_ciphers = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] glance.tls_min_version = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.backend_availability_zone = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.chap_password = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.chap_username = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.disk_geometry = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.driver_client_cert = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.driver_client_cert_key = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.driver_data_namespace = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.driver_use_ssl = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.extra_capabilities = {} {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.filter_function = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.goodness_function = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.iscsi_target_flags = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.iscsi_write_cache = on {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.iser_helper = tgtadm {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.iser_ip_address = 192.168.122.156 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.iser_port = 3260 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.lvm_share_target = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.lvm_type = auto {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.num_shell_tries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.replication_device = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.report_discard_supported = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.reserved_percentage = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.target_helper = tgtadm {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.target_ip_address = 192.168.122.156 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.target_port = 3260 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.target_protocol = iscsi {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.trace_flags = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.unique_fqdn_network = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.use_chap_auth = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.volume_backend_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.volume_clear = zero {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.volume_clear_ionice = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.volume_clear_size = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_reports.file_event_handler = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_reports.log_dir = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.backend_host = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.chap_password = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.chap_username = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.disk_geometry = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.driver_client_cert = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.extra_capabilities = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.filter_function = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.goodness_function = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.iser_helper = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.iser_ip_address = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.iser_port = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.lvm_share_target = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.lvm_type = auto {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.num_shell_tries = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.replication_device = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.report_discard_supported = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.reserved_percentage = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.scst_target_driver = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.storage_protocol = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.target_helper = lioadm {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.target_ip_address = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.target_port = 3260 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.trace_flags = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.use_chap_auth = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.volume_clear = zero {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.volume_clear_size = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] lvmdriver-1.volumes_dir = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.ssl = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_notifications.driver = [] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_notifications.retry = -1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] key_manager.fixed_key = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.barbican_api_version = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.barbican_endpoint = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.barbican_endpoint_type = public {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.barbican_region_name = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.cafile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.collect_timing = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.insecure = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.number_of_retries = 60 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.retry_delay = 1 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.send_service_user_token = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.split_loggers = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.timeout = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.tls_ciphers = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.tls_min_version = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.verify_ssl = True {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican.verify_ssl_path = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican_service_user.auth_section = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican_service_user.auth_type = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican_service_user.cafile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican_service_user.certfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican_service_user.collect_timing = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican_service_user.insecure = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican_service_user.keyfile = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican_service_user.split_loggers = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican_service_user.timeout = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican_service_user.tls_ciphers = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] barbican_service_user.tls_min_version = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.approle_role_id = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.approle_secret_id = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.auth_method = approle {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.auth_path = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.kv_mountpoint = secret {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.kv_path = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.kv_version = 2 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.namespace = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.root_token_id = **** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.ssl_ca_crt_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.timeout = 60.0 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.token_file = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.token_role = None {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.use_ssl = False {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:25:28 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] ******************************************************************************** {{(pid=75835) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 16:25:28 devstack sudo[75985]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:28 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.467s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:28 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:28 devstack sudo[76120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 16:25:28 devstack sudo[76120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:29 devstack sudo[76120]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:29 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.302s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:29 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:25:29 devstack cinder-volume[75981]: INFO cinder.brick.local_dev.lvm [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 29 16:25:29 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:29 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:29 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:29 devstack sudo[76239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 16:25:29 devstack sudo[76239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:29 devstack sudo[76239]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:29 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:29 devstack cinder-volume[75981]: DEBUG cinder.brick.local_dev.lvm [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75981) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 29 16:25:29 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:29 devstack sudo[76330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 16:25:29 devstack sudo[76330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:30 devstack sudo[76330]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:30 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.486s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:30 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:30 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:30 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:30 devstack sudo[76510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 16:25:30 devstack sudo[76510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:30 devstack sudo[76510]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:30 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:30 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:30 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:30 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:30 devstack sudo[76595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 29 16:25:30 devstack sudo[76595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:30 devstack sudo[76595]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:30 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.240s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:30 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:30 devstack sudo[76598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 16:25:30 devstack sudo[76598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:30 devstack sudo[76598]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:30 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:30 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:30 devstack sudo[76681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 16:25:30 devstack sudo[76681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:31 devstack sudo[76681]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:31 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:31 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:31 devstack sudo[76689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 16:25:31 devstack sudo[76689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:31 devstack sudo[76689]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:31 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.370s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:31 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:31 devstack sudo[76774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 16:25:31 devstack sudo[76774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:31 devstack sudo[76774]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:31 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:31 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:31 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:31 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:31 devstack sudo[76778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 16:25:31 devstack sudo[76778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:32 devstack sudo[76778]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:32 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:32 devstack cinder-volume[75981]: INFO cinder.volume.drivers.lvm [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 29 16:25:32 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:32 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:32 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:32 devstack sudo[76782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 16:25:32 devstack sudo[76782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:32 devstack sudo[76782]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:32 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:32 devstack cinder-volume[75981]: DEBUG cinder.volume.drivers.lvm [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Updating volume stats {{(pid=75981) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 16:25:32 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:32 devstack sudo[76791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 16:25:32 devstack sudo[76791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:32 devstack sudo[76791]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:32 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:32 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:32 devstack sudo[76794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 16:25:32 devstack sudo[76794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:33 devstack sudo[76794]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:33 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:33 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:33 devstack sudo[76797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 16:25:33 devstack sudo[76797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:33 devstack sudo[76797]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:33 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:33 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:33 devstack sudo[76800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 16:25:33 devstack sudo[76800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:33 devstack sudo[76800]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:33 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:33 devstack cinder-volume[75981]: INFO cinder.volume.driver [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Driver hasn't implemented _init_vendor_properties() Sep 29 16:25:33 devstack cinder-volume[75981]: DEBUG cinder.volume.driver [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75981) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 16:25:33 devstack cinder-volume[75981]: DEBUG oslo_db.sqlalchemy.engines [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75981) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 16:25:33 devstack cinder-volume[75981]: DEBUG dbcounter [-] [75981] Writer thread running {{(pid=75981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 16:25:33 devstack cinder-volume[75981]: DEBUG cinder.db.api [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Building query based on filter {{(pid=75981) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 16:25:33 devstack cinder-volume[75981]: DEBUG cinder.image.image_utils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75981) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 16:25:33 devstack cinder-volume[75981]: INFO cinder.keymgr.migration [None req-1277c939-3255-44c0-998c-701eaf9ee223 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 16:25:33 devstack cinder-volume[75981]: DEBUG cinder.volume.drivers.lvm [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Updating volume stats {{(pid=75981) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 16:25:33 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:33 devstack sudo[76804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 16:25:33 devstack sudo[76804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:33 devstack sudo[76804]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:33 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:33 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:33 devstack sudo[76808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 16:25:33 devstack sudo[76808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:34 devstack sudo[76808]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:34 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:34 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:34 devstack sudo[76812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 16:25:34 devstack sudo[76812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:34 devstack sudo[76812]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:34 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:34 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:34 devstack sudo[76815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 16:25:34 devstack sudo[76815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:34 devstack sudo[76815]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:34 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:34 devstack cinder-volume[75981]: DEBUG cinder.manager [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Notifying Schedulers of capabilities ... {{(pid=75981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:25:34 devstack cinder-volume[75981]: INFO cinder.volume.manager [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Driver initialization completed successfully. Sep 29 16:25:34 devstack cinder-volume[75981]: INFO cinder.manager [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Initiating service 2 cleanup Sep 29 16:25:34 devstack cinder-volume[75981]: INFO cinder.manager [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Service 2 cleanup completed. Sep 29 16:25:34 devstack cinder-volume[75981]: DEBUG cinder.service [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Creating RPC server for service cinder-volume {{(pid=75981) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 16:25:34 devstack cinder-volume[75981]: DEBUG cinder.service [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75981) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 16:25:34 devstack cinder-volume[75981]: INFO cinder.volume.manager [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 29 16:25:34 devstack cinder-volume[75981]: DEBUG cinder.volume.drivers.lvm [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Updating volume stats {{(pid=75981) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 16:25:34 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:34 devstack sudo[76819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 16:25:34 devstack sudo[76819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:35 devstack sudo[76819]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:35 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:35 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:35 devstack sudo[76823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 16:25:35 devstack sudo[76823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:35 devstack sudo[76823]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:35 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:35 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:35 devstack sudo[76826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 16:25:35 devstack sudo[76826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:35 devstack sudo[76826]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:35 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:35 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:25:35 devstack sudo[76832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 16:25:35 devstack sudo[76832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:25:36 devstack sudo[76832]: pam_unix(sudo:session): session closed for user root Sep 29 16:25:36 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:25:36 devstack cinder-volume[75981]: INFO cinder.volume.manager [None req-9c44cbc9-77e5-4e1b-9de1-f2f39c12c1a8 None None] Driver post RPC initialization completed successfully. Sep 29 16:25:38 devstack cinder-volume[75835]: DEBUG dbcounter [-] [75835] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75835) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:25:46 devstack cinder-volume[75981]: DEBUG dbcounter [-] [75981] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:25:46 devstack cinder-volume[75981]: DEBUG dbcounter [-] [75981] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:26:05 devstack cinder-volume[75981]: DEBUG oslo_service.periodic_task [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running periodic task VolumeManager._thread_info {{(pid=75981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:26:05 devstack cinder-volume[75981]: DEBUG cinder.volume.manager [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] thread count: 6 {{(pid=75981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:26:05 devstack cinder-volume[75981]: DEBUG cinder.volume.manager [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] thread info: [<_MainThread(MainThread, started 126885319458944)>, , , , , ] {{(pid=75981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:27:05 devstack cinder-volume[75981]: DEBUG oslo_service.periodic_task [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:27:05 devstack cinder-volume[75981]: DEBUG cinder.volume.drivers.lvm [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Updating volume stats {{(pid=75981) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 16:27:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:27:05 devstack sudo[81880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 16:27:05 devstack sudo[81880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:27:05 devstack sudo[81880]: pam_unix(sudo:session): session closed for user root Sep 29 16:27:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:27:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:27:05 devstack sudo[81899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 16:27:05 devstack sudo[81899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:27:05 devstack sudo[81899]: pam_unix(sudo:session): session closed for user root Sep 29 16:27:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:27:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:27:05 devstack sudo[81902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 16:27:05 devstack sudo[81902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:27:05 devstack sudo[81902]: pam_unix(sudo:session): session closed for user root Sep 29 16:27:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:27:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:27:05 devstack sudo[81905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 16:27:05 devstack sudo[81905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:27:06 devstack sudo[81905]: pam_unix(sudo:session): session closed for user root Sep 29 16:27:06 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.236s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:27:06 devstack cinder-volume[75981]: DEBUG cinder.manager [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Notifying Schedulers of capabilities ... {{(pid=75981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:27:06 devstack cinder-volume[75981]: DEBUG oslo_service.periodic_task [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running periodic task VolumeManager._thread_info {{(pid=75981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:27:06 devstack cinder-volume[75981]: DEBUG cinder.volume.manager [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] thread count: 6 {{(pid=75981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:27:06 devstack cinder-volume[75981]: DEBUG cinder.volume.manager [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] thread info: [<_MainThread(MainThread, started 126885319458944)>, , , , , ] {{(pid=75981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:27:46 devstack cinder-volume[75981]: DEBUG dbcounter [-] [75981] Writing DB stats cinder:SELECT=1 {{(pid=75981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:27:46 devstack cinder-volume[75981]: DEBUG dbcounter [-] [75981] Writing DB stats cinder:UPDATE=1 {{(pid=75981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:28:05 devstack cinder-volume[75981]: DEBUG oslo_service.periodic_task [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:28:05 devstack cinder-volume[75981]: DEBUG cinder.volume.drivers.lvm [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Updating volume stats {{(pid=75981) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 16:28:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:28:05 devstack sudo[83393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 16:28:05 devstack sudo[83393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:28:05 devstack sudo[83393]: pam_unix(sudo:session): session closed for user root Sep 29 16:28:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:28:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:28:05 devstack sudo[83396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 16:28:05 devstack sudo[83396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:28:05 devstack sudo[83396]: pam_unix(sudo:session): session closed for user root Sep 29 16:28:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:28:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:28:05 devstack sudo[83399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 16:28:05 devstack sudo[83399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:28:05 devstack sudo[83399]: pam_unix(sudo:session): session closed for user root Sep 29 16:28:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:28:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:28:05 devstack sudo[83403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 16:28:05 devstack sudo[83403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:28:06 devstack sudo[83403]: pam_unix(sudo:session): session closed for user root Sep 29 16:28:06 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:28:06 devstack cinder-volume[75981]: DEBUG cinder.manager [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Notifying Schedulers of capabilities ... {{(pid=75981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:28:06 devstack cinder-volume[75981]: DEBUG oslo_service.periodic_task [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running periodic task VolumeManager._thread_info {{(pid=75981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:28:06 devstack cinder-volume[75981]: DEBUG cinder.volume.manager [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] thread count: 6 {{(pid=75981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:28:06 devstack cinder-volume[75981]: DEBUG cinder.volume.manager [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] thread info: [<_MainThread(MainThread, started 126885319458944)>, , , , , ] {{(pid=75981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:29:05 devstack cinder-volume[75981]: DEBUG oslo_service.periodic_task [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:29:05 devstack cinder-volume[75981]: DEBUG cinder.volume.drivers.lvm [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Updating volume stats {{(pid=75981) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 16:29:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:29:05 devstack sudo[84898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 16:29:05 devstack sudo[84898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:29:05 devstack sudo[84898]: pam_unix(sudo:session): session closed for user root Sep 29 16:29:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:29:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:29:05 devstack sudo[84901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 16:29:05 devstack sudo[84901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:29:05 devstack sudo[84901]: pam_unix(sudo:session): session closed for user root Sep 29 16:29:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:29:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:29:05 devstack sudo[84907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 16:29:05 devstack sudo[84907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:29:05 devstack sudo[84907]: pam_unix(sudo:session): session closed for user root Sep 29 16:29:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:29:05 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:29:05 devstack sudo[84910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 16:29:05 devstack sudo[84910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:29:06 devstack sudo[84910]: pam_unix(sudo:session): session closed for user root Sep 29 16:29:06 devstack cinder-volume[75981]: DEBUG oslo_concurrency.processutils [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75981) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:29:06 devstack cinder-volume[75981]: DEBUG cinder.manager [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Notifying Schedulers of capabilities ... {{(pid=75981) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:29:06 devstack cinder-volume[75981]: DEBUG oslo_service.periodic_task [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] Running periodic task VolumeManager._thread_info {{(pid=75981) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:29:06 devstack cinder-volume[75981]: DEBUG cinder.volume.manager [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] thread count: 6 {{(pid=75981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:29:06 devstack cinder-volume[75981]: DEBUG cinder.volume.manager [None req-46642790-d607-4f0f-b597-36db67f6caf3 None None] thread info: [<_MainThread(MainThread, started 126885319458944)>, , , , , ] {{(pid=75981) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:29:46 devstack cinder-volume[75981]: DEBUG dbcounter [-] [75981] Writing DB stats cinder:SELECT=1 {{(pid=75981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:29:46 devstack cinder-volume[75981]: DEBUG dbcounter [-] [75981] Writing DB stats cinder:UPDATE=1 {{(pid=75981) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:29:51 devstack cinder-volume[75835]: INFO oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Caught SIGTERM, stopping children Sep 29 16:29:51 devstack cinder-volume[75835]: DEBUG oslo_concurrency.lockutils [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Acquiring lock "singleton_lock" {{(pid=75835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 16:29:51 devstack cinder-volume[75835]: DEBUG oslo_concurrency.lockutils [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Acquired lock "singleton_lock" {{(pid=75835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 16:29:51 devstack cinder-volume[75835]: DEBUG oslo_concurrency.lockutils [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Releasing lock "singleton_lock" {{(pid=75835) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 16:29:51 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Stop services. {{(pid=75835) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 29 16:29:51 devstack cinder-volume[75835]: DEBUG oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Killing children. {{(pid=75835) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 29 16:29:51 devstack cinder-volume[75835]: INFO oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Waiting on 1 children to exit Sep 29 16:29:54 devstack cinder-volume[75981]: DEBUG oslo_concurrency.lockutils [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Acquiring lock "singleton_lock" {{(pid=75981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 16:29:54 devstack cinder-volume[75981]: DEBUG oslo_concurrency.lockutils [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Acquired lock "singleton_lock" {{(pid=75981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 16:29:54 devstack cinder-volume[75981]: DEBUG oslo_concurrency.lockutils [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Releasing lock "singleton_lock" {{(pid=75981) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 16:29:54 devstack cinder-volume[75981]: WARNING amqp [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 16:29:54 devstack cinder-volume[75981]: WARNING amqp [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 16:29:54 devstack cinder-volume[75835]: INFO oslo_service.backend._eventlet.service [None req-69f91e09-f16a-43f7-8764-c299d667aef8 None None] Child 75981 exited with status 0 Sep 29 16:29:55 devstack cinder-volume[85910]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 16:29:55 devstack cinder-volume[85910]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 16:29:55 devstack cinder-volume[85910]: we strongly recommend against using it for new projects. Sep 29 16:29:55 devstack cinder-volume[85910]: If you are already using Eventlet, we recommend migrating to a different Sep 29 16:29:55 devstack cinder-volume[85910]: framework. For more detail see Sep 29 16:29:55 devstack cinder-volume[85910]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 16:29:55 devstack cinder-volume[85910]: import eventlet # noqa Sep 29 16:29:57 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 16:29:57 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 16:29:57 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 16:29:57 devstack cinder-volume[85910]: INFO dbcounter [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Registered counter for database cinder Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_db.sqlalchemy.engines [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG dbcounter [-] [85910] Writer thread running {{(pid=85910) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 16:29:58 devstack cinder-volume[85910]: INFO cinder.rpc [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 16:29:58 devstack cinder-volume[85910]: INFO cinder.rpc [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_db.sqlalchemy.engines [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 16:29:58 devstack cinder-volume[85910]: INFO cinder.volume.manager [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Determined volume DB was empty at startup. Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG cinder.volume.manager [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85910) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 29 16:29:58 devstack cinder-volume[85910]: INFO cinder.volume.manager [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 29 16:29:58 devstack cinder-volume[85910]: WARNING stevedore.named [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 16:29:58 devstack cinder-volume[85910]: WARNING castellan.key_manager [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 16:29:58 devstack cinder-volume[85910]: WARNING cinder.keymgr.conf_key_mgr [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 16:29:58 devstack cinder-volume[85910]: INFO cinder.volume.manager [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_db.sqlalchemy.engines [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85910) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 16:29:58 devstack cinder-volume[85910]: INFO oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Starting 1 workers Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Started child 86124 {{(pid=85910) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Full set of CONF: {{(pid=85910) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] ******************************************************************************** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Configuration options gathered from: {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] ================================================================================ {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] allow_availability_zone_fallback = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] allow_compression_on_image_upload = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[86124]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] allowed_direct_url_schemes = [] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] api_rate_limit = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] auth_strategy = keystone {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_availability_zone = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_host = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_name = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_stats_polling_interval = 60 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backup_api_class = cinder.backup.api.API {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backup_name_template = backup-%s {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backup_use_same_host = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backup_use_temp_snapshot = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] chap_password = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] chap_username = {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cinder_internal_tenant_project_id = 3bbd32baa9714dc7b4bc477b57b1de03 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cinder_internal_tenant_user_id = fd7fda817c5f40ba8f0892cae5832dfd {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cluster = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] compression_format = gzip {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] compute_api_class = cinder.compute.nova.API {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] config_dir = [] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] config_source = [] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] control_exchange = openstack {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] debug = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] default_availability_zone = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] default_group_type = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] default_volume_type = QuobyteHD {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] disk_geometry = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] driver_client_cert = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] driver_client_cert_key = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] driver_data_namespace = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] driver_ssl_cert_path = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] driver_ssl_cert_verify = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] driver_use_ssl = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] enable_new_services = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] enable_unsupported_driver = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] enabled_backends = ['QuobyteHD'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] enforce_multipath_for_image_xfer = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] filter_function = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance_api_insecure = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance_api_servers = ['http://192.168.122.156/image'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance_api_ssl_compression = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance_ca_certificates_file = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance_catalog_info = image:glance:publicURL {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance_certfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance_keyfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance_num_retries = 3 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance_request_timeout = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] goodness_function = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] graceful_shutdown_timeout = 5 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] group_api_class = cinder.group.api.API {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] host = devstack {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] image_compress_on_upload = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] image_conversion_address_space_limit = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] image_conversion_cpu_limit = 60 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] image_conversion_disable = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] image_introspection_address_space_limit = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] image_introspection_cpu_limit = 60 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] image_upload_use_cinder_backend = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] image_upload_use_internal_tenant = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] image_volume_cache_enabled = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] image_volume_cache_max_count = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] image_volume_cache_max_size_gb = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] init_host_max_objects_retrieval = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] instance_format = [instance: %(uuid)s] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] iscsi_target_flags = {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] iscsi_write_cache = on {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] iser_helper = tgtadm {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] iser_ip_address = 192.168.122.156 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] iser_port = 3260 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] log_color = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] log_config_append = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] log_dir = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] log_file = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] log_options = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] log_rotate_interval = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] log_rotate_interval_type = days {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] log_rotation_type = none {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[86124]: INFO cinder.volume.manager [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] max_age = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] max_logfile_count = 30 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] max_logfile_size_mb = 200 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] max_over_subscription_ratio = 20.0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] message_reap_interval = 86400 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] message_ttl = 2592000 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] migration_create_volume_timeout_secs = 300 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] monkey_patch = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] monkey_patch_modules = [] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] my_ip = 192.168.122.156 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] no_snapshot_gb_quota = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] num_iser_scan_tries = 3 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] num_shell_tries = 3 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] num_volume_device_scan_tries = 3 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[86124]: DEBUG cinder.volume.drivers.remotefs [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86124) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] nvmeof_conn_info_version = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] nvmet_ns_id = 10 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] nvmet_port_id = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] osapi_max_limit = 1000 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] osapi_volume_ext_list = [] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] osapi_volume_listen_port = 8776 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] osapi_volume_use_ssl = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] osapi_volume_workers = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] per_volume_size_limit = -1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] periodic_fuzzy_delay = 60 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] periodic_interval = 60 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] public_endpoint = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] publish_errors = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] quota_backup_gigabytes = 1000 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] quota_backups = 10 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] quota_gigabytes = 1000 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] quota_groups = 10 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] quota_snapshots = 10 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] quota_volumes = 10 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] rate_limit_burst = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] rate_limit_except_level = CRITICAL {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] rate_limit_interval = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] reinit_driver_count = 3 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] replication_device = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] report_discard_supported = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] report_interval = 120 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] reservation_clean_interval = 86400 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] reservation_expire = 86400 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] reserved_image_namespaces = [] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] reserved_percentage = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] rpc_response_timeout = 120 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] run_external_periodic_tasks = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] scst_target_driver = iscsi {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] scst_target_iqn_name = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] service_down_time = 720 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] shell_completion = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] snapshot_name_template = snapshot-%s {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] split_loggers = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] state_path = /opt/stack/data/cinder {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] storage_availability_zone = nova {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] storage_protocol = iSCSI {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] syslog_log_facility = LOG_USER {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] target_helper = lioadm {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] target_ip_address = 192.168.122.156 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] target_port = 3260 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] target_protocol = iscsi {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] target_secondary_ip_addresses = [] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] trace_flags = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] transport_url = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] until_refresh = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] use_chap_auth = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] use_default_quota_class = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] use_journal = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] use_json = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] use_multipath_for_image_xfer = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] use_stderr = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] use_syslog = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] verify_glance_signatures = enabled {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] volume_api_class = cinder.volume.api.API {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] volume_backend_name = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] volume_clear = zero {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] volume_clear_ionice = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] volume_clear_size = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] volume_copy_bps_limit = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] volume_dd_blocksize = 1M {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] volume_name_template = volume-%s {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] volume_service_inithost_offload = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] volume_usage_audit_period = month {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] zoning_mode = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_concurrency.disable_process_locking = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.auth_section = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.auth_type = password {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.auth_version = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.cache = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.certfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.include_service_catalog = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.insecure = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.interface = public {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.keyfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_password = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcache_username = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.region_name = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.service_type = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.156/identity {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.backend = dogpile.cache.null {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.backend_argument = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.backend_expiration_time = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.config_prefix = cache.oslo {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.debug_cache_backend = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.enable_retry_client = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.enable_socket_keepalive = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.enabled = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.expiration_time = 600 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.hashclient_retry_attempts = 2 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.memcache_dead_retry = 300 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.memcache_pool_maxsize = 10 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.memcache_sasl_enabled = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.password = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.proxies = [] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.redis_db = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.redis_server = localhost:6379 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.retry_attempts = 2 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.retry_delay = 0.0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.socket_keepalive_count = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.socket_keepalive_idle = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.socket_keepalive_interval = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.socket_timeout = 1.0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.tls_allowed_ciphers = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.tls_cafile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.tls_certfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.tls_enabled = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.tls_keyfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cache.username = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] coordination.backend_url = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.asyncio_connection = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.asyncio_slave_connection = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.backend = sqlalchemy {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.connection = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.connection_debug = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.connection_parameters = {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.connection_recycle_time = 3600 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.connection_trace = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.db_inc_retry_interval = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.db_max_retries = 20 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.db_max_retry_interval = 10 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.db_retry_interval = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.max_overflow = 50 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.max_pool_size = 5 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.max_retries = 10 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.mysql_wsrep_sync_wait = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.pool_timeout = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.retry_interval = 10 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.slave_connection = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.sqlite_synchronous = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.synchronous_reader = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] database.use_db_reconnect = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[86124]: DEBUG cinder.volume.drivers.quobyte [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86124) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[86124]: WARNING cinder.volume.drivers.quobyte [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[86124]: WARNING cinder.volume.drivers.quobyte [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_tracing.insecure = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[86124]: DEBUG oslo_concurrency.processutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Running cmd (subprocess): mount.quobyte {{(pid=86124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] profiler.connection_string = messaging:// {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] profiler.enabled = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] profiler.es_doc_type = notification {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] profiler.es_scroll_size = 10000 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] profiler.es_scroll_time = 2m {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] profiler.filter_error_trace = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] profiler.hmac_keys = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] profiler.sentinel_service_name = mymaster {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] profiler.socket_timeout = 0.1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] profiler.trace_requests = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] profiler.trace_sqlalchemy = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] profiler_jaeger.process_tags = {} {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] profiler_jaeger.service_name_prefix = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] profiler_otlp.service_name_prefix = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_policy.enforce_new_defaults = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_policy.policy_default_rule = default {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_policy.policy_file = policy.yaml {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] privsep_osbrick.group = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] privsep_osbrick.helper_command = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] privsep_osbrick.user = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cinder_sys_admin.group = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cinder_sys_admin.helper_command = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] cinder_sys_admin.user = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] service_user.auth_section = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] service_user.auth_type = password {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] service_user.cafile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] service_user.certfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] service_user.collect_timing = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] service_user.insecure = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] service_user.keyfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] service_user.send_service_user_token = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] service_user.split_loggers = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] service_user.timeout = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] service_user.tls_ciphers = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] service_user.tls_min_version = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance.auth_section = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance.auth_type = password {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance.certfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance.collect_timing = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance.insecure = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance.keyfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance.region_name = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance.split_loggers = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance.timeout = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance.tls_ciphers = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] glance.tls_min_version = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.backend_availability_zone = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.chap_password = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.chap_username = {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.disk_geometry = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.driver_client_cert = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.driver_client_cert_key = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.driver_data_namespace = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.driver_use_ssl = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.extra_capabilities = {} {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.filter_function = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.goodness_function = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.iscsi_target_flags = {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.iscsi_write_cache = on {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.iser_helper = tgtadm {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.iser_ip_address = 192.168.122.156 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.iser_port = 3260 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.nas_host = {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.nas_login = admin {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.nas_mount_options = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.nas_password = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.nas_private_key = {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.nas_share_path = {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.num_shell_tries = 3 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.quobyte_volume_url = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.replication_device = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.report_discard_supported = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.reserved_percentage = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.target_helper = tgtadm {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.target_ip_address = 192.168.122.156 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.target_port = 3260 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.target_protocol = iscsi {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.trace_flags = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.unique_fqdn_network = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.use_chap_auth = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.volume_backend_name = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.volume_clear = zero {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.volume_clear_ionice = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.volume_clear_size = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_reports.file_event_handler = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_reports.log_dir = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.backend_availability_zone = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.backend_host = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.chap_password = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.chap_username = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.chiscsi_conf = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.disk_geometry = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.driver_client_cert = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.driver_data_namespace = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.driver_use_ssl = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.extra_capabilities = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.filter_function = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.goodness_function = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack quobyte-client[86125]: Reading configuration file: /etc/quobyte/client.cfg Sep 29 16:29:58 devstack quobyte-client[86125]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.iser_helper = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.iser_ip_address = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.iser_port = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.iser_target_prefix = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.nas_host = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.nas_login = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.nas_mount_options = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.nas_password = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.nas_private_key = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:58 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG oslo_concurrency.processutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] CMD "mount.quobyte" returned: 1 in 0.118s {{(pid=86124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.nas_share_path = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG oslo_concurrency.lockutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.nas_ssh_port = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG oslo_concurrency.lockutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.num_shell_tries = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.nvmet_port_id = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.replication_device = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.report_discard_supported = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.reserved_percentage = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.scst_target_driver = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.storage_protocol = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.target_helper = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.target_ip_address = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG cinder.volume.drivers.quobyte [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.target_port = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.target_prefix = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.target_protocol = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[86124]: INFO cinder.volume.drivers.quobyte [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb ... Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.trace_flags = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.use_chap_auth = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.volume_clear = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.volume_clear_size = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] QuobyteHD.volumes_dir = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG oslo_concurrency.processutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba -c /etc/quobyte/client-cinder.cfg {{(pid=86124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.ssl = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_notifications.driver = [] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_notifications.retry = -1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] key_manager.fixed_key = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.barbican_api_version = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.barbican_endpoint = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.barbican_endpoint_type = public {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.barbican_region_name = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.cafile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.certfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.collect_timing = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.insecure = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.keyfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.number_of_retries = 60 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.retry_delay = 1 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.send_service_user_token = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.split_loggers = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.timeout = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.tls_ciphers = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.tls_min_version = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.verify_ssl = True {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican.verify_ssl_path = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican_service_user.auth_section = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican_service_user.auth_type = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican_service_user.cafile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican_service_user.certfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack sudo[86126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba -c /etc/quobyte/client-cinder.cfg Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican_service_user.collect_timing = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican_service_user.insecure = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican_service_user.keyfile = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican_service_user.split_loggers = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican_service_user.timeout = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican_service_user.tls_ciphers = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] barbican_service_user.tls_min_version = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.approle_role_id = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.approle_secret_id = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.auth_method = approle {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.auth_path = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.kv_mountpoint = secret {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.kv_path = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.kv_version = 2 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.namespace = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.root_token_id = **** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.ssl_ca_crt_file = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.timeout = 60.0 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.token_file = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.token_role = None {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.use_ssl = False {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:29:59 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] ******************************************************************************** {{(pid=85910) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 16:29:59 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG oslo_concurrency.processutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.476s {{(pid=86124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:29:59 devstack cinder-volume[86124]: INFO cinder.volume.drivers.quobyte [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb succeeded Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG cinder.volume.drivers.quobyte [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG oslo_concurrency.lockutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.496s {{(pid=86124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG oslo_concurrency.processutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:29:59 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:29:59 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:29:59 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG oslo_concurrency.processutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.245s {{(pid=86124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:29:59 devstack cinder-volume[86124]: INFO cinder.volume.driver [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Driver hasn't implemented _init_vendor_properties() Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG cinder.volume.driver [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.009204864502, 'free_capacity_gb': 1775.009204864502, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86124) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG oslo_db.sqlalchemy.engines [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86124) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG dbcounter [-] [86124] Writer thread running {{(pid=86124) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG cinder.db.api [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Building query based on filter {{(pid=86124) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG cinder.image.image_utils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86124) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 16:29:59 devstack cinder-volume[86124]: INFO cinder.keymgr.migration [None req-3744b2de-137f-4590-a748-8717fb28919a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG oslo_concurrency.lockutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG oslo_concurrency.lockutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG cinder.volume.drivers.quobyte [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG cinder.volume.drivers.quobyte [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG oslo_concurrency.lockutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:29:59 devstack cinder-volume[86124]: DEBUG oslo_concurrency.processutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:29:59 devstack sudo[86235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:29:59 devstack sudo[86235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:30:00 devstack sudo[86235]: pam_unix(sudo:session): session closed for user root Sep 29 16:30:00 devstack cinder-volume[86124]: DEBUG oslo_concurrency.processutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.263s {{(pid=86124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:30:00 devstack cinder-volume[86124]: DEBUG cinder.manager [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Notifying Schedulers of capabilities ... {{(pid=86124) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:30:00 devstack cinder-volume[86124]: INFO cinder.volume.manager [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Driver initialization completed successfully. Sep 29 16:30:00 devstack cinder-volume[86124]: INFO cinder.manager [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Initiating service 3 cleanup Sep 29 16:30:00 devstack cinder-volume[86124]: INFO cinder.manager [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Service 3 cleanup completed. Sep 29 16:30:00 devstack cinder-volume[86124]: DEBUG cinder.service [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Creating RPC server for service cinder-volume {{(pid=86124) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 16:30:00 devstack cinder-volume[86124]: DEBUG cinder.service [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86124) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 16:30:00 devstack cinder-volume[86124]: INFO cinder.volume.manager [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 29 16:30:00 devstack cinder-volume[86124]: DEBUG oslo_concurrency.lockutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:30:00 devstack cinder-volume[86124]: DEBUG oslo_concurrency.lockutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:30:00 devstack cinder-volume[86124]: DEBUG cinder.volume.drivers.quobyte [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86124) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:30:00 devstack cinder-volume[86124]: DEBUG cinder.volume.drivers.quobyte [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86124) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:30:00 devstack cinder-volume[86124]: DEBUG oslo_concurrency.lockutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86124) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:30:00 devstack cinder-volume[86124]: DEBUG oslo_concurrency.processutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:30:00 devstack sudo[86238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:30:00 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:30:00 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root Sep 29 16:30:00 devstack cinder-volume[86124]: DEBUG oslo_concurrency.processutils [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.274s {{(pid=86124) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:30:00 devstack cinder-volume[86124]: INFO cinder.volume.manager [None req-c74e72de-257c-4f7e-b9e5-771ca9e8dea6 None None] Driver post RPC initialization completed successfully. Sep 29 16:30:05 devstack cinder-volume[85910]: INFO oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Caught SIGTERM, stopping children Sep 29 16:30:05 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Acquiring lock "singleton_lock" {{(pid=85910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 16:30:05 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Acquired lock "singleton_lock" {{(pid=85910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 16:30:05 devstack cinder-volume[85910]: DEBUG oslo_concurrency.lockutils [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Releasing lock "singleton_lock" {{(pid=85910) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 16:30:05 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Stop services. {{(pid=85910) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 29 16:30:05 devstack cinder-volume[85910]: DEBUG oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Killing children. {{(pid=85910) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 29 16:30:05 devstack cinder-volume[85910]: INFO oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Waiting on 1 children to exit Sep 29 16:30:08 devstack cinder-volume[86124]: DEBUG oslo_concurrency.lockutils [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Acquiring lock "singleton_lock" {{(pid=86124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 16:30:08 devstack cinder-volume[86124]: DEBUG oslo_concurrency.lockutils [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Acquired lock "singleton_lock" {{(pid=86124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 16:30:08 devstack cinder-volume[86124]: DEBUG oslo_concurrency.lockutils [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Releasing lock "singleton_lock" {{(pid=86124) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 16:30:08 devstack cinder-volume[86124]: WARNING amqp [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 16:30:08 devstack cinder-volume[86124]: WARNING amqp [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 16:30:08 devstack cinder-volume[85910]: INFO oslo_service.backend._eventlet.service [None req-aba371a5-1934-42b2-9980-d0025e08cb54 None None] Child 86124 exited with status 0 Sep 29 16:30:09 devstack cinder-volume[86445]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 16:30:09 devstack cinder-volume[86445]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 16:30:09 devstack cinder-volume[86445]: we strongly recommend against using it for new projects. Sep 29 16:30:09 devstack cinder-volume[86445]: If you are already using Eventlet, we recommend migrating to a different Sep 29 16:30:09 devstack cinder-volume[86445]: framework. For more detail see Sep 29 16:30:09 devstack cinder-volume[86445]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 16:30:09 devstack cinder-volume[86445]: import eventlet # noqa Sep 29 16:30:12 devstack cinder-volume[86445]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86445) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 16:30:12 devstack cinder-volume[86445]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86445) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 16:30:12 devstack cinder-volume[86445]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86445) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 16:30:12 devstack cinder-volume[86445]: INFO dbcounter [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] Registered counter for database cinder Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_db.sqlalchemy.engines [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86445) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG dbcounter [-] [86445] Writer thread running {{(pid=86445) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 16:30:13 devstack cinder-volume[86445]: INFO cinder.rpc [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 16:30:13 devstack cinder-volume[86445]: INFO cinder.rpc [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_db.sqlalchemy.engines [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86445) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 16:30:13 devstack cinder-volume[86445]: INFO cinder.volume.manager [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] Determined volume DB was empty at startup. Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG cinder.volume.manager [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86445) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 29 16:30:13 devstack cinder-volume[86445]: WARNING stevedore.named [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 16:30:13 devstack cinder-volume[86445]: WARNING castellan.key_manager [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 16:30:13 devstack cinder-volume[86445]: WARNING cinder.keymgr.conf_key_mgr [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 16:30:13 devstack cinder-volume[86445]: INFO cinder.volume.manager [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_db.sqlalchemy.engines [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86445) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 16:30:13 devstack cinder-volume[86445]: INFO oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] Starting 1 workers Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] Started child 86793 {{(pid=86445) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] Full set of CONF: {{(pid=86445) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] ******************************************************************************** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] Configuration options gathered from: {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] ================================================================================ {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] allow_availability_zone_fallback = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] allow_compression_on_image_upload = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] allowed_direct_url_schemes = [] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] api_rate_limit = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] auth_strategy = keystone {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_availability_zone = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86793]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_host = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_name = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_stats_polling_interval = 60 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backup_api_class = cinder.backup.api.API {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backup_name_template = backup-%s {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backup_use_same_host = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backup_use_temp_snapshot = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] chap_password = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] chap_username = {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cinder_internal_tenant_project_id = 3bbd32baa9714dc7b4bc477b57b1de03 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cinder_internal_tenant_user_id = fd7fda817c5f40ba8f0892cae5832dfd {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cluster = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] compression_format = gzip {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] compute_api_class = cinder.compute.nova.API {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] config_dir = [] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] config_source = [] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] control_exchange = openstack {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] debug = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] default_availability_zone = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] default_group_type = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] default_volume_type = QuobyteHD {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] disk_geometry = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] driver_client_cert = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] driver_client_cert_key = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] driver_data_namespace = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] driver_ssl_cert_path = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] driver_ssl_cert_verify = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] driver_use_ssl = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] enable_new_services = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] enable_unsupported_driver = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] enabled_backends = ['QuobyteHD'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] enforce_multipath_for_image_xfer = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] filter_function = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance_api_insecure = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance_api_servers = ['http://192.168.122.156/image'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance_api_ssl_compression = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance_ca_certificates_file = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance_catalog_info = image:glance:publicURL {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance_certfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance_keyfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance_num_retries = 3 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance_request_timeout = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] goodness_function = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] graceful_shutdown_timeout = 5 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] group_api_class = cinder.group.api.API {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] host = devstack {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] image_compress_on_upload = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] image_conversion_address_space_limit = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] image_conversion_cpu_limit = 60 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] image_conversion_disable = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] image_introspection_address_space_limit = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] image_introspection_cpu_limit = 60 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] image_upload_use_cinder_backend = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] image_upload_use_internal_tenant = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] image_volume_cache_enabled = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] image_volume_cache_max_count = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] image_volume_cache_max_size_gb = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] init_host_max_objects_retrieval = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] instance_format = [instance: %(uuid)s] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] iscsi_target_flags = {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] iscsi_write_cache = on {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] iser_helper = tgtadm {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] iser_ip_address = 192.168.122.156 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] iser_port = 3260 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] log_color = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] log_config_append = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] log_dir = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] log_file = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] log_options = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] log_rotate_interval = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] log_rotate_interval_type = days {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] log_rotation_type = none {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] max_age = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] max_logfile_count = 30 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] max_logfile_size_mb = 200 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] max_over_subscription_ratio = 20.0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] message_reap_interval = 86400 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] message_ttl = 2592000 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] migration_create_volume_timeout_secs = 300 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] monkey_patch = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] monkey_patch_modules = [] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] my_ip = 192.168.122.156 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] no_snapshot_gb_quota = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] num_iser_scan_tries = 3 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86793) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] num_shell_tries = 3 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] num_volume_device_scan_tries = 3 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] nvmeof_conn_info_version = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] nvmet_ns_id = 10 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] nvmet_port_id = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] osapi_max_limit = 1000 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] osapi_volume_ext_list = [] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] osapi_volume_listen_port = 8776 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] osapi_volume_use_ssl = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] osapi_volume_workers = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] per_volume_size_limit = -1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] periodic_fuzzy_delay = 60 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] periodic_interval = 60 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] public_endpoint = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] publish_errors = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] quota_backup_gigabytes = 1000 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] quota_backups = 10 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] quota_gigabytes = 1000 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] quota_groups = 10 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] quota_snapshots = 10 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] quota_volumes = 10 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] rate_limit_burst = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] rate_limit_except_level = CRITICAL {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] rate_limit_interval = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] reinit_driver_count = 3 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] replication_device = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] report_discard_supported = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] report_interval = 120 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] reservation_clean_interval = 86400 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] reservation_expire = 86400 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] reserved_image_namespaces = [] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] reserved_percentage = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] rpc_response_timeout = 120 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] run_external_periodic_tasks = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] scst_target_driver = iscsi {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] scst_target_iqn_name = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] service_down_time = 720 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] shell_completion = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] snapshot_name_template = snapshot-%s {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] split_loggers = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] state_path = /opt/stack/data/cinder {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] storage_availability_zone = nova {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] storage_protocol = iSCSI {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] syslog_log_facility = LOG_USER {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] target_helper = lioadm {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] target_ip_address = 192.168.122.156 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] target_port = 3260 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] target_protocol = iscsi {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] target_secondary_ip_addresses = [] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] trace_flags = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] transport_url = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] until_refresh = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] use_chap_auth = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] use_default_quota_class = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] use_journal = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] use_json = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] use_multipath_for_image_xfer = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] use_stderr = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] use_syslog = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] verify_glance_signatures = enabled {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] volume_api_class = cinder.volume.api.API {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] volume_backend_name = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] volume_clear = zero {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] volume_clear_ionice = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] volume_clear_size = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] volume_copy_bps_limit = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] volume_dd_blocksize = 1M {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] volume_name_template = volume-%s {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] volume_service_inithost_offload = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] volume_usage_audit_period = month {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] zoning_mode = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_concurrency.disable_process_locking = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.auth_section = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.auth_type = password {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.auth_version = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.cache = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.certfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.include_service_catalog = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.insecure = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.interface = public {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.keyfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_password = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcache_username = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.region_name = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.service_type = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.156/identity {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.backend = dogpile.cache.null {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.backend_argument = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.backend_expiration_time = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.config_prefix = cache.oslo {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.debug_cache_backend = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.enable_retry_client = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.enable_socket_keepalive = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.enabled = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.expiration_time = 600 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.hashclient_retry_attempts = 2 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.memcache_dead_retry = 300 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.memcache_pool_maxsize = 10 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.memcache_sasl_enabled = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.password = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.proxies = [] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.redis_db = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.redis_server = localhost:6379 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.retry_attempts = 2 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.retry_delay = 0.0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.socket_keepalive_count = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.socket_keepalive_idle = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.socket_keepalive_interval = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.socket_timeout = 1.0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.tls_allowed_ciphers = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.tls_cafile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.tls_certfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.tls_enabled = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.tls_keyfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cache.username = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] coordination.backend_url = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.asyncio_connection = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.asyncio_slave_connection = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.backend = sqlalchemy {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.connection = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.connection_debug = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.connection_parameters = {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.connection_recycle_time = 3600 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.connection_trace = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.db_inc_retry_interval = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.db_max_retries = 20 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.db_max_retry_interval = 10 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.db_retry_interval = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.max_overflow = 50 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.max_pool_size = 5 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.max_retries = 10 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.mysql_wsrep_sync_wait = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.pool_timeout = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.retry_interval = 10 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.slave_connection = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.sqlite_synchronous = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.synchronous_reader = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] database.use_db_reconnect = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_tracing.insecure = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] profiler.connection_string = messaging:// {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] profiler.enabled = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] profiler.es_doc_type = notification {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] profiler.es_scroll_size = 10000 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] profiler.es_scroll_time = 2m {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] profiler.filter_error_trace = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] profiler.hmac_keys = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] profiler.sentinel_service_name = mymaster {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] profiler.socket_timeout = 0.1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] profiler.trace_requests = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] profiler.trace_sqlalchemy = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86793) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] profiler_jaeger.process_tags = {} {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] profiler_jaeger.service_name_prefix = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] profiler_otlp.service_name_prefix = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_policy.enforce_new_defaults = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_policy.policy_default_rule = default {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.quobyte [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_policy.policy_file = policy.yaml {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.quobyte [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Running cmd (subprocess): mount.quobyte {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] privsep_osbrick.group = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] privsep_osbrick.helper_command = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] privsep_osbrick.user = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cinder_sys_admin.group = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cinder_sys_admin.helper_command = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] cinder_sys_admin.user = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] service_user.auth_section = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] service_user.auth_type = password {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] service_user.cafile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] service_user.certfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] service_user.collect_timing = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] service_user.insecure = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] service_user.keyfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] service_user.send_service_user_token = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] service_user.split_loggers = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] service_user.timeout = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] service_user.tls_ciphers = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] service_user.tls_min_version = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance.auth_section = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance.auth_type = password {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance.certfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance.collect_timing = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance.insecure = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance.keyfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance.region_name = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance.split_loggers = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance.timeout = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance.tls_ciphers = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] glance.tls_min_version = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.backend_availability_zone = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.chap_password = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.chap_username = {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.disk_geometry = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.driver_client_cert = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.driver_client_cert_key = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.driver_data_namespace = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.driver_use_ssl = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.extra_capabilities = {} {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.filter_function = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.goodness_function = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.iscsi_target_flags = {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.iscsi_write_cache = on {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.iser_helper = tgtadm {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.iser_ip_address = 192.168.122.156 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.iser_port = 3260 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.nas_host = {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.nas_login = admin {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.nas_mount_options = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.nas_password = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.nas_private_key = {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.nas_share_path = {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.num_shell_tries = 3 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.quobyte_volume_url = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.replication_device = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.report_discard_supported = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.reserved_percentage = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.target_helper = tgtadm {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.target_ip_address = 192.168.122.156 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.target_port = 3260 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.target_protocol = iscsi {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.trace_flags = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.unique_fqdn_network = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.use_chap_auth = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.volume_backend_name = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.volume_clear = zero {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.volume_clear_ionice = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.volume_clear_size = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_reports.file_event_handler = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_reports.log_dir = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.backend_availability_zone = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.backend_host = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack quobyte-client[86794]: Reading configuration file: /etc/quobyte/client.cfg Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.chap_password = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack quobyte-client[86794]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.chap_username = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.chiscsi_conf = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.disk_geometry = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.driver_client_cert = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] CMD "mount.quobyte" returned: 1 in 0.051s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:30:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:30:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:30:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.driver_data_namespace = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.driver_use_ssl = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.extra_capabilities = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.filter_function = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.goodness_function = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.iser_helper = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.iser_ip_address = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.iser_port = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.iser_target_prefix = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.nas_host = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.nas_login = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.nas_mount_options = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.nas_password = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.nas_private_key = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.nas_share_path = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.nas_ssh_port = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.num_shell_tries = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.nvmet_port_id = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.replication_device = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.report_discard_supported = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.reserved_percentage = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.scst_target_driver = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.storage_protocol = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.target_helper = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.target_ip_address = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.target_port = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.target_prefix = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.target_protocol = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.trace_flags = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.use_chap_auth = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.volume_clear = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.volume_clear_size = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] QuobyteHD.volumes_dir = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.ssl = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_notifications.driver = [] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_notifications.retry = -1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] key_manager.fixed_key = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.barbican_api_version = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.barbican_endpoint = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.barbican_endpoint_type = public {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.barbican_region_name = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.cafile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.certfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.collect_timing = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.insecure = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.keyfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.number_of_retries = 60 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.retry_delay = 1 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.send_service_user_token = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.split_loggers = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.timeout = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.tls_ciphers = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.tls_min_version = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.verify_ssl = True {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican.verify_ssl_path = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican_service_user.auth_section = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican_service_user.auth_type = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican_service_user.cafile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican_service_user.certfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican_service_user.collect_timing = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican_service_user.insecure = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican_service_user.keyfile = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican_service_user.split_loggers = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican_service_user.timeout = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican_service_user.tls_ciphers = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] barbican_service_user.tls_min_version = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.approle_role_id = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.approle_secret_id = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.auth_method = approle {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.auth_path = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.kv_mountpoint = secret {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.kv_path = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.kv_version = 2 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.namespace = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.root_token_id = **** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.ssl_ca_crt_file = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.timeout = 60.0 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.token_file = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.token_role = None {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.use_ssl = False {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 16:30:13 devstack cinder-volume[86445]: DEBUG oslo_service.backend._eventlet.service [None req-2eda8cfb-e433-443f-a5cb-a93dbe5d3f22 None None] ******************************************************************************** {{(pid=86445) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 16:30:13 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Sep 29 16:30:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.243s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:30:13 devstack cinder-volume[86793]: INFO cinder.volume.driver [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Driver hasn't implemented _init_vendor_properties() Sep 29 16:30:13 devstack cinder-volume[86793]: DEBUG cinder.volume.driver [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.01070022583, 'free_capacity_gb': 1775.01070022583, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86793) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG oslo_db.sqlalchemy.engines [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86793) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writer thread running {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG cinder.db.api [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Building query based on filter {{(pid=86793) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86793) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:30:14 devstack cinder-volume[86793]: INFO cinder.keymgr.migration [None req-8c78b503-7e6e-4c8a-b035-a831aa5d7e5a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 16:30:14 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:30:14 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:30:14 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.254s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:30:14 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Driver initialization completed successfully. Sep 29 16:30:14 devstack cinder-volume[86793]: INFO cinder.manager [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Initiating service 3 cleanup Sep 29 16:30:14 devstack cinder-volume[86793]: INFO cinder.manager [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Service 3 cleanup completed. Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG cinder.service [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Creating RPC server for service cinder-volume {{(pid=86793) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG cinder.service [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86793) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 16:30:14 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:30:14 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:30:14 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:30:14 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Sep 29 16:30:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.249s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:30:14 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fc9f1377-f003-4ea5-8549-86bdb48cad76 None None] Driver post RPC initialization completed successfully. Sep 29 16:30:23 devstack cinder-volume[86445]: DEBUG dbcounter [-] [86445] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86445) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:30:24 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=1 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:30:24 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:30:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:30:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 6 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:30:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:31:11 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Flow 'volume_create_manager' (9fd6cdfb-3dd9-43be-b592-00b62e75140b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f43d7c-be72-4635-a2d3-d05d59e45cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f43d7c-be72-4635-a2d3-d05d59e45cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1847516998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe53f91-0ba2-400a-9b05-cfac23afa123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c585962a214f97ae9646a35d4f7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:31:12Z,use_quota=True,user_id='db1aaced0d19425e821f6339e0918b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d20e002-eb54-4d78-b12f-ab555fd50e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d20e002-eb54-4d78-b12f-ab555fd50e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7f4810-f5b9-433e-ae51-7a256bca8984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7f4810-f5b9-433e-ae51-7a256bca8984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fe53f91-0ba2-400a-9b05-cfac23afa123', 'volume_name': 'volume-3fe53f91-0ba2-400a-9b05-cfac23afa123', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fb5c7f-b9a7-4b29-90f9-e0aac4ebcfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fb5c7f-b9a7-4b29-90f9-e0aac4ebcfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed357bfe-7eb6-4292-8862-d1892807b3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Volume 3fe53f91-0ba2-400a-9b05-cfac23afa123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fe53f91-0ba2-400a-9b05-cfac23afa123', 'volume_size': 1} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1847516998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe53f91-0ba2-400a-9b05-cfac23afa123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9c585962a214f97ae9646a35d4f7323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:31:12Z,use_quota=True,user_id='db1aaced0d19425e821f6339e0918b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Creating volume 3fe53f91-0ba2-400a-9b05-cfac23afa123 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:31:12 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3fe53f91-0ba2-400a-9b05-cfac23afa123 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:12 devstack sudo[87332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3fe53f91-0ba2-400a-9b05-cfac23afa123 1073741824 Sep 29 16:31:12 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Flow 'volume_create_manager' (43e57407-68fd-4578-bf6b-ca606085d1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a3a52d-1fa7-473e-a135-5ff8dfd789dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02a3a52d-1fa7-473e-a135-5ff8dfd789dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-538677136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47525de5-d80f-4866-aa6c-f96e9610d99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d588feb483480da4a2231a0d75cea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:31:12Z,use_quota=True,user_id='8b10e866f0594cc6aa2f687e733e27ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd3ff06-3214-42c2-9504-c133fbcbd569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd3ff06-3214-42c2-9504-c133fbcbd569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7990c31b-f38c-4e08-ac94-67ec9ce65098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7990c31b-f38c-4e08-ac94-67ec9ce65098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47525de5-d80f-4866-aa6c-f96e9610d99d', 'volume_name': 'volume-47525de5-d80f-4866-aa6c-f96e9610d99d', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2ac2a7-8fa2-4b4f-a904-5924522aef2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2ac2a7-8fa2-4b4f-a904-5924522aef2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175efb69-7264-4804-9772-e429819228b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Volume 47525de5-d80f-4866-aa6c-f96e9610d99d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47525de5-d80f-4866-aa6c-f96e9610d99d', 'volume_size': 1} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Flow 'volume_create_manager' (9121e987-81d9-43c0-adce-c37f9f6b3efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ea81b0-231d-4031-9072-4aa7f23b4275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ea81b0-231d-4031-9072-4aa7f23b4275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-162215070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e287823-7bee-4724-835a-8f3b75f125dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63446b0d3dc04ec4b9ecd6967b823b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:31:13Z,use_quota=True,user_id='0899ebf0e3c041a5b7313e4571709c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb80279-0315-48cd-a5f3-916cf57f0074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb80279-0315-48cd-a5f3-916cf57f0074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a853d4-d23d-4237-a157-df550714d376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a853d4-d23d-4237-a157-df550714d376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e287823-7bee-4724-835a-8f3b75f125dc', 'volume_name': 'volume-8e287823-7bee-4724-835a-8f3b75f125dc', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d053c43-9b8a-4733-b030-7032995cf8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d053c43-9b8a-4733-b030-7032995cf8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a28c1a-a9c8-4c8c-9f1f-7ccd56851ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:12 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Volume 8e287823-7bee-4724-835a-8f3b75f125dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e287823-7bee-4724-835a-8f3b75f125dc', 'volume_size': 1} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3fe53f91-0ba2-400a-9b05-cfac23afa123 1073741824" returned: 0 in 0.741s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3fe53f91-0ba2-400a-9b05-cfac23afa123 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:12 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3fe53f91-0ba2-400a-9b05-cfac23afa123 Sep 29 16:31:12 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:13 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3fe53f91-0ba2-400a-9b05-cfac23afa123" returned: 0 in 0.263s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.681s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-538677136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47525de5-d80f-4866-aa6c-f96e9610d99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d588feb483480da4a2231a0d75cea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:31:12Z,use_quota=True,user_id='8b10e866f0594cc6aa2f687e733e27ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Creating volume 47525de5-d80f-4866-aa6c-f96e9610d99d {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:31:13 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed357bfe-7eb6-4292-8862-d1892807b3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fe53f91-0ba2-400a-9b05-cfac23afa123', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:13 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d 1073741824 Sep 29 16:31:13 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7883a0dd-5f40-4383-87ff-f78b1d83adcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:13 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Volume volume-3fe53f91-0ba2-400a-9b05-cfac23afa123 (3fe53f91-0ba2-400a-9b05-cfac23afa123): created successfully Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7883a0dd-5f40-4383-87ff-f78b1d83adcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Flow 'volume_create_manager' (9fd6cdfb-3dd9-43be-b592-00b62e75140b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:31:13 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c027716d-7c19-4b29-a37a-4d99e732e60d tempest-TaggedAttachmentsTest-664069431 None] Created volume successfully. Sep 29 16:31:13 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d 1073741824" returned: 0 in 0.414s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:13 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d Sep 29 16:31:13 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:13 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d" returned: 0 in 0.270s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.092s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-162215070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e287823-7bee-4724-835a-8f3b75f125dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63446b0d3dc04ec4b9ecd6967b823b96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:31:13Z,use_quota=True,user_id='0899ebf0e3c041a5b7313e4571709c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Creating volume 8e287823-7bee-4724-835a-8f3b75f125dc {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:31:13 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:31:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e287823-7bee-4724-835a-8f3b75f125dc 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175efb69-7264-4804-9772-e429819228b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47525de5-d80f-4866-aa6c-f96e9610d99d', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:14 devstack sudo[87661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e287823-7bee-4724-835a-8f3b75f125dc 1073741824 Sep 29 16:31:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0ba684-f686-43c7-b87f-da53ea50f8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:14 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:14 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Volume volume-47525de5-d80f-4866-aa6c-f96e9610d99d (47525de5-d80f-4866-aa6c-f96e9610d99d): created successfully Sep 29 16:31:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0ba684-f686-43c7-b87f-da53ea50f8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Flow 'volume_create_manager' (43e57407-68fd-4578-bf6b-ca606085d1e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:31:14 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-cb89be9b-8e79-4f51-af32-49e7f30d8277 req-a62885ec-1d17-4a9d-843b-ea5e5cb2a084 tempest-VolumesSnapshotsTestJSON-955590413 None] Created volume successfully. Sep 29 16:31:14 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e287823-7bee-4724-835a-8f3b75f125dc 1073741824" returned: 0 in 0.870s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e287823-7bee-4724-835a-8f3b75f125dc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:15 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e287823-7bee-4724-835a-8f3b75f125dc Sep 29 16:31:15 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:15 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e287823-7bee-4724-835a-8f3b75f125dc" returned: 0 in 0.348s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:31:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.439s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a28c1a-a9c8-4c8c-9f1f-7ccd56851ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e287823-7bee-4724-835a-8f3b75f125dc', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9da113-f73e-4c80-86e1-b281c53955b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:15 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Volume volume-8e287823-7bee-4724-835a-8f3b75f125dc (8e287823-7bee-4724-835a-8f3b75f125dc): created successfully Sep 29 16:31:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f9da113-f73e-4c80-86e1-b281c53955b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Flow 'volume_create_manager' (9121e987-81d9-43c0-adce-c37f9f6b3efc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:31:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] Creating offline snapshot 3b1cd6e6-5c68-453f-b19d-210ed6e74c3e of volume 47525de5-d80f-4866-aa6c-f96e9610d99d {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:31:15 devstack cinder-volume[86793]: INFO oslo.privsep.daemon [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjqadf6p4/privsep.sock'] Sep 29 16:31:15 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-475c662e-2543-4b7a-b9a1-77435e1c25a7 tempest-DeleteServersTestJSON-1102767288 None] Created volume successfully. Sep 29 16:31:15 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjqadf6p4/privsep.sock Sep 29 16:31:15 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:16 devstack cinder-volume[86793]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 29 16:31:16 devstack cinder-volume[86793]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 16:31:16 devstack cinder-volume[86793]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 29 16:31:16 devstack cinder-volume[86793]: WARNING oslo.privsep.daemon [-] privsep log: Sep 29 16:31:16 devstack cinder-volume[86793]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 29 16:31:16 devstack cinder-volume[86793]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 29 16:31:16 devstack cinder-volume[86793]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 16:31:16 devstack cinder-volume[86793]: WARNING oslo.privsep.daemon [-] privsep log: Sep 29 16:31:16 devstack cinder-volume[86793]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 29 16:31:17 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:17 devstack cinder-volume[86793]: INFO oslo.privsep.daemon [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] Spawned new privsep daemon via rootwrap Sep 29 16:31:17 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] Accepted privsep connection to /tmp/tmpjqadf6p4/privsep.sock {{(pid=86793) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 29 16:31:17 devstack cinder-volume[86793]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 29 16:31:17 devstack cinder-volume[86793]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 29 16:31:17 devstack cinder-volume[86793]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 29 16:31:17 devstack cinder-volume[86793]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87677 Sep 29 16:31:17 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aa0f86-a0a1-4c64-92ce-021180ae9b48]: (2,) {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:31:17 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2fd753-0dcc-4b8d-a3f0-d209edb9b499]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:31:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:17 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d Sep 29 16:31:17 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:18 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d" returned: 0 in 0.832s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:18 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e 1G Sep 29 16:31:18 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:19 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e 1G" returned: 0 in 0.802s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47525de5-d80f-4866-aa6c-f96e9610d99d -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:19 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47525de5-d80f-4866-aa6c-f96e9610d99d -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e Sep 29 16:31:19 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:19 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47525de5-d80f-4866-aa6c-f96e9610d99d -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e" returned: 0 in 0.377s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:19 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e is being set with open permissions: ugo+rw Sep 29 16:31:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:19 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e Sep 29 16:31:19 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:19 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e" returned: 0 in 0.312s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:19 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.info Sep 29 16:31:19 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:20 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.info" returned: 0 in 0.378s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:20 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.info is being set with open permissions: ugo+rw Sep 29 16:31:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:20 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.info Sep 29 16:31:20 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:20 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.info" returned: 0 in 0.306s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.150s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:20 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-61c92460-9590-4d55-bacf-4deca9d82b1e req-82fc0b67-f9e0-4aa0-a1c3-334722829757 tempest-VolumesSnapshotsTestJSON-955590413 None] Create snapshot completed successfully Sep 29 16:31:20 devstack cinder-volume[86793]: WARNING py.warnings [req-347ccfd1-30e8-4485-bee8-9d4c516a1c90 req-d3feba94-eaf2-4a3c-b244-af94f00e597c tempest-DeleteServersTestJSON-1102767288 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 29 16:31:20 devstack cinder-volume[86793]: .first() Sep 29 16:31:20 devstack cinder-volume[86793]: Sep 29 16:31:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-347ccfd1-30e8-4485-bee8-9d4c516a1c90 req-d3feba94-eaf2-4a3c-b244-af94f00e597c tempest-DeleteServersTestJSON-1102767288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-347ccfd1-30e8-4485-bee8-9d4c516a1c90 req-d3feba94-eaf2-4a3c-b244-af94f00e597c tempest-DeleteServersTestJSON-1102767288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-347ccfd1-30e8-4485-bee8-9d4c516a1c90 req-d3feba94-eaf2-4a3c-b244-af94f00e597c tempest-DeleteServersTestJSON-1102767288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-347ccfd1-30e8-4485-bee8-9d4c516a1c90 req-d3feba94-eaf2-4a3c-b244-af94f00e597c tempest-DeleteServersTestJSON-1102767288 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-8e287823-7bee-4724-835a-8f3b75f125dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8840458b-2cf5-48b5-a128-795db00b843d', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:31:20 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-347ccfd1-30e8-4485-bee8-9d4c516a1c90 req-d3feba94-eaf2-4a3c-b244-af94f00e597c tempest-DeleteServersTestJSON-1102767288 None] attachment_update completed successfully. Sep 29 16:31:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Acquiring lock "cinder-3b1cd6e6-5c68-453f-b19d-210ed6e74c3e-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:31:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "cinder-3b1cd6e6-5c68-453f-b19d-210ed6e74c3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:31:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Acquiring lock "cinder-quobyte-47525de5-d80f-4866-aa6c-f96e9610d99d" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:31:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "cinder-quobyte-47525de5-d80f-4866-aa6c-f96e9610d99d" acquired by "delete_snapshot" :: waited 0.078s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:31:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Acquiring lock "cinder-quobyte-3b1cd6e6-5c68-453f-b19d-210ed6e74c3e" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:31:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "cinder-quobyte-3b1cd6e6-5c68-453f-b19d-210ed6e74c3e" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:31:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Deleting offline snapshot 3b1cd6e6-5c68-453f-b19d-210ed6e74c3e of volume 47525de5-d80f-4866-aa6c-f96e9610d99d {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:31:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] snapshot_file for this snap is: volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:31:21 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[937b7fcd-df70-4f07-96fa-d6e621fe09ae]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:31:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:21 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e Sep 29 16:31:21 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:22 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e" returned: 0 in 0.648s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47525de5-d80f-4866-aa6c-f96e9610d99d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:31:22 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d4fcac-e719-4808-bf66-324ff8c10764]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:31:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:22 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d Sep 29 16:31:22 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:22 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d" returned: 0 in 0.677s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:22 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e Sep 29 16:31:22 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:23 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e" returned: 0 in 0.493s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:23 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e Sep 29 16:31:23 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:23 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d.3b1cd6e6-5c68-453f-b19d-210ed6e74c3e" returned: 0 in 0.447s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "cinder-quobyte-3b1cd6e6-5c68-453f-b19d-210ed6e74c3e" released by "_delete_snapshot" :: held 2.484s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:31:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "cinder-quobyte-47525de5-d80f-4866-aa6c-f96e9610d99d" released by "delete_snapshot" :: held 2.535s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:31:24 devstack cinder-volume[86793]: WARNING cinder.quota [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:31:24 devstack cinder-volume[86793]: WARNING cinder.quota [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:31:24 devstack cinder-volume[86793]: DEBUG cinder.quota [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Created reservations ['c44e8d45-7525-4047-95fc-9f2ace860ae1', '02274350-fa75-4a9a-a1e0-97a531664707', '808f6c0f-8250-475c-bc55-11166e306b0b', '31b4357d-96e3-4437-9bb0-5007ac4ff329'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:31:24 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Delete snapshot completed successfully. Sep 29 16:31:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-f5ea7233-2086-4098-ab7d-ecfc6e9d69b5 req-b467f63f-9993-40d7-a4df-9a231bca9262 tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "cinder-3b1cd6e6-5c68-453f-b19d-210ed6e74c3e-delete_snapshot" released by "delete_snapshot" :: held 2.927s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:31:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Acquiring lock "cinder-47525de5-d80f-4866-aa6c-f96e9610d99d-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:31:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "cinder-47525de5-d80f-4866-aa6c-f96e9610d99d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:31:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Acquiring lock "cinder-quobyte-47525de5-d80f-4866-aa6c-f96e9610d99d" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:31:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "cinder-quobyte-47525de5-d80f-4866-aa6c-f96e9610d99d" acquired by "delete_volume" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:31:25 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6ceb5b-8120-4c79-9caa-cbc0d410a6be]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:31:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:25 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d Sep 29 16:31:25 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:25 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d" returned: 0 in 0.442s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:25 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d Sep 29 16:31:25 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:25 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-43d80548-39c9-47b0-8f7a-9c1b77181fbd req-f6253a0a-29ab-4184-97fe-9193afec9068 tempest-DeleteServersTestJSON-1102767288 None] Terminate volume connection completed successfully. Sep 29 16:31:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-43d80548-39c9-47b0-8f7a-9c1b77181fbd req-f6253a0a-29ab-4184-97fe-9193afec9068 tempest-DeleteServersTestJSON-1102767288 None] Deleting attachment 8840458b-2cf5-48b5-a128-795db00b843d. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:31:25 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47525de5-d80f-4866-aa6c-f96e9610d99d" returned: 0 in 0.449s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "cinder-quobyte-47525de5-d80f-4866-aa6c-f96e9610d99d" released by "delete_volume" :: held 0.991s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:31:26 devstack cinder-volume[86793]: WARNING cinder.quota [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:31:26 devstack cinder-volume[86793]: DEBUG cinder.quota [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Created reservations ['bc350e9a-85bf-4896-9bf2-a2b1d14e1eb7', 'c60eb120-ff0f-41d7-b15c-220e9e513ade', '344d2e62-eb85-4dfb-9574-c8c016bd619d', '8d12b8e5-8c55-43d2-91c5-33ca3f4adade'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:31:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:31:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:31:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:26 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:31:26 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:26 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.391s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:26 devstack cinder-volume[86793]: DEBUG cinder.manager [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:31:26 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Deleted volume successfully. Sep 29 16:31:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-ce59e42c-517c-4306-be4e-dfba33605632 req-94eb57c6-06de-4867-af6e-dc940c63529d tempest-VolumesSnapshotsTestJSON-955590413 None] Lock "cinder-47525de5-d80f-4866-aa6c-f96e9610d99d-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:31:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Acquiring lock "cinder-8e287823-7bee-4724-835a-8f3b75f125dc-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:31:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Lock "cinder-8e287823-7bee-4724-835a-8f3b75f125dc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:31:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Acquiring lock "cinder-quobyte-8e287823-7bee-4724-835a-8f3b75f125dc" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:31:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Lock "cinder-quobyte-8e287823-7bee-4724-835a-8f3b75f125dc" acquired by "delete_volume" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:31:28 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba86355e-2ec2-44b9-b6fa-52ba0c2878ae]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:31:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e287823-7bee-4724-835a-8f3b75f125dc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:28 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e287823-7bee-4724-835a-8f3b75f125dc Sep 29 16:31:28 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:28 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e287823-7bee-4724-835a-8f3b75f125dc" returned: 0 in 0.699s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e287823-7bee-4724-835a-8f3b75f125dc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:28 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e287823-7bee-4724-835a-8f3b75f125dc Sep 29 16:31:28 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:29 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e287823-7bee-4724-835a-8f3b75f125dc" returned: 0 in 0.408s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Lock "cinder-quobyte-8e287823-7bee-4724-835a-8f3b75f125dc" released by "delete_volume" :: held 1.175s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:31:29 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Created reservations ['2b72018f-2b24-45fc-9545-5303a858c095', '06f7bcd3-83f0-42e4-9f8c-2f6f7c487a05', 'af9bc5b7-9fdd-425d-91a4-4ba3e588e8e4', 'c9a22216-596c-4363-a616-c19f6b0a7f3c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:31:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:29 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:31:29 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:31:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:29 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:31:29 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:29 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.350s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:29 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:31:29 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Deleted volume successfully. Sep 29 16:31:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-34ab1629-0254-4a49-824d-0937e034deb9 tempest-DeleteServersTestJSON-1102767288 None] Lock "cinder-8e287823-7bee-4724-835a-8f3b75f125dc-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:31:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:31:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:31:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:31:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:34 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:31:34 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:35 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.367s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:31:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:31:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 8 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:31:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:31:39 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=29,cinder:UPDATE=33,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:31:39 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=34,cinder:SELECT=36,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:31:46 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f3e03490-abe5-4b41-a568-707acb3e2b0b tempest-GroupsTest-222230637 None] Group tempest-Group1-1074470512: creating Sep 29 16:31:46 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f3e03490-abe5-4b41-a568-707acb3e2b0b tempest-GroupsTest-222230637 None] Group tempest-Group1-1074470512: created successfully Sep 29 16:31:46 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f3e03490-abe5-4b41-a568-707acb3e2b0b tempest-GroupsTest-222230637 None] Create group completed successfully. Sep 29 16:31:47 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-05502095-e50b-476c-ae77-8dca36d6afe6 tempest-GroupsTest-222230637 None] Group tempest-Group2-2100984470: creating Sep 29 16:31:47 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-05502095-e50b-476c-ae77-8dca36d6afe6 tempest-GroupsTest-222230637 None] Group tempest-Group2-2100984470: created successfully Sep 29 16:31:47 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-05502095-e50b-476c-ae77-8dca36d6afe6 tempest-GroupsTest-222230637 None] Create group completed successfully. Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Flow 'volume_create_manager' (2806234c-6565-4afb-8c82-f576ace46c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b3ec66-202b-4477-a25e-f178b6595e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b3ec66-202b-4477-a25e-f178b6595e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1071835690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c581e107-c42d-4961-bb35-8e59553ce6c6,host='devstack@QuobyteHD#QuobyteHD',id=8162498b-d307-48da-9e1e-8683e27c2ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f60c38a87af46669c8f8dd48c0cfc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:31:49Z,use_quota=True,user_id='53db073c3fcd4b269462def398282d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1faab66-10dc-49bd-bd73-f037b2391738),volume_type_id=d1faab66-10dc-49bd-bd73-f037b2391738)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d6562d-7d1d-4278-a0fa-4e0e0764f97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d6562d-7d1d-4278-a0fa-4e0e0764f97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a54e3b-6ea2-4e80-9021-b5be3aa688fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a54e3b-6ea2-4e80-9021-b5be3aa688fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8162498b-d307-48da-9e1e-8683e27c2ca1', 'volume_name': 'volume-8162498b-d307-48da-9e1e-8683e27c2ca1', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ccce661-905b-4804-af53-49857c9cd025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ccce661-905b-4804-af53-49857c9cd025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f112a73-82d9-4343-8319-7f28897f20bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:49 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Volume 8162498b-d307-48da-9e1e-8683e27c2ca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8162498b-d307-48da-9e1e-8683e27c2ca1', 'volume_size': 1} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c581e107-c42d-4961-bb35-8e59553ce6c6,created_at=2026-09-29T14:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1071835690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c581e107-c42d-4961-bb35-8e59553ce6c6,host='devstack@QuobyteHD#QuobyteHD',id=8162498b-d307-48da-9e1e-8683e27c2ca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f60c38a87af46669c8f8dd48c0cfc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:31:49Z,use_quota=True,user_id='53db073c3fcd4b269462def398282d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1faab66-10dc-49bd-bd73-f037b2391738),volume_type_id=d1faab66-10dc-49bd-bd73-f037b2391738)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Creating volume 8162498b-d307-48da-9e1e-8683e27c2ca1 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:31:49 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:31:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8162498b-d307-48da-9e1e-8683e27c2ca1 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:49 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8162498b-d307-48da-9e1e-8683e27c2ca1 1073741824 Sep 29 16:31:49 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:50 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8162498b-d307-48da-9e1e-8683e27c2ca1 1073741824" returned: 0 in 0.481s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8162498b-d307-48da-9e1e-8683e27c2ca1 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:50 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8162498b-d307-48da-9e1e-8683e27c2ca1 Sep 29 16:31:50 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:50 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8162498b-d307-48da-9e1e-8683e27c2ca1" returned: 0 in 0.475s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:31:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f112a73-82d9-4343-8319-7f28897f20bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8162498b-d307-48da-9e1e-8683e27c2ca1', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b0b054-fea8-4195-8bc7-d799a5668bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:50 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Volume volume-8162498b-d307-48da-9e1e-8683e27c2ca1 (8162498b-d307-48da-9e1e-8683e27c2ca1): created successfully Sep 29 16:31:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b0b054-fea8-4195-8bc7-d799a5668bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Flow 'volume_create_manager' (2806234c-6565-4afb-8c82-f576ace46c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:31:50 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5c856d1e-f877-4101-a705-8e838b5902ee tempest-GroupsTest-222230637 None] Created volume successfully. Sep 29 16:31:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Acquiring lock "cinder-quobyte-8162498b-d307-48da-9e1e-8683e27c2ca1" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:31:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Lock "cinder-quobyte-8162498b-d307-48da-9e1e-8683e27c2ca1" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:31:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc13c9fa-4ada-4a85-8a34-2409e5c8075a]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:31:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8162498b-d307-48da-9e1e-8683e27c2ca1 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:53 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8162498b-d307-48da-9e1e-8683e27c2ca1 Sep 29 16:31:53 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:53 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8162498b-d307-48da-9e1e-8683e27c2ca1" returned: 0 in 0.477s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8162498b-d307-48da-9e1e-8683e27c2ca1 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:53 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8162498b-d307-48da-9e1e-8683e27c2ca1 Sep 29 16:31:53 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:53 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8162498b-d307-48da-9e1e-8683e27c2ca1" returned: 0 in 0.379s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Lock "cinder-quobyte-8162498b-d307-48da-9e1e-8683e27c2ca1" released by "delete_volume" :: held 0.920s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:31:53 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Created reservations ['719e7792-7781-4d66-bcac-878276b3fe9b'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:31:54 devstack cinder-volume[86793]: WARNING cinder.quota [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2143148465 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2143148465, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:31:54 devstack cinder-volume[86793]: WARNING cinder.quota [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2143148465 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2143148465, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:31:54 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Created reservations ['21e18701-4c30-49a2-acbc-8f8104d77600', '50e9ae21-c775-4027-848c-b3af17999c40', 'd229c306-63ce-4e88-ac76-38baeecc0309', '0a246481-e498-4a96-bf0b-344793d7748c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:31:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:31:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:31:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:54 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:31:54 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:54 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.259s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:54 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:31:54 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-96866d31-0c7b-4b8a-ba13-114bc7abc49d tempest-GroupsTest-222230637 None] Delete group completed successfully. Sep 29 16:31:55 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-44f93cb4-399a-4956-9931-6bc1f83237cd tempest-GroupsTest-222230637 None] Created reservations ['5e11ae7c-3aab-4673-b562-8c1a68679704'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:31:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-44f93cb4-399a-4956-9931-6bc1f83237cd tempest-GroupsTest-222230637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-44f93cb4-399a-4956-9931-6bc1f83237cd tempest-GroupsTest-222230637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-44f93cb4-399a-4956-9931-6bc1f83237cd tempest-GroupsTest-222230637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:31:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-44f93cb4-399a-4956-9931-6bc1f83237cd tempest-GroupsTest-222230637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:31:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-44f93cb4-399a-4956-9931-6bc1f83237cd tempest-GroupsTest-222230637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-44f93cb4-399a-4956-9931-6bc1f83237cd tempest-GroupsTest-222230637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:55 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:31:55 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:31:55 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Sep 29 16:31:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-44f93cb4-399a-4956-9931-6bc1f83237cd tempest-GroupsTest-222230637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.267s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:31:55 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-44f93cb4-399a-4956-9931-6bc1f83237cd tempest-GroupsTest-222230637 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:31:55 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-44f93cb4-399a-4956-9931-6bc1f83237cd tempest-GroupsTest-222230637 None] Delete group completed successfully. Sep 29 16:31:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a4812f7f-281e-424c-bacf-f06b02a19fdc tempest-GroupsTest-222230637 None] Group tempest-GroupsTest-Group-1019235480: creating Sep 29 16:31:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a4812f7f-281e-424c-bacf-f06b02a19fdc tempest-GroupsTest-222230637 None] Group tempest-GroupsTest-Group-1019235480: created successfully Sep 29 16:31:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a4812f7f-281e-424c-bacf-f06b02a19fdc tempest-GroupsTest-222230637 None] Create group completed successfully. Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Flow 'volume_create_manager' (e83663e5-57a0-4af2-a46b-de8919f37a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddf091b-3dbd-41c0-b33d-cd2b9423aa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cddf091b-3dbd-41c0-b33d-cd2b9423aa1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1679723824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b74e99e5-21a4-4b3c-af0c-e2cc274e7bd8,host='devstack@QuobyteHD#QuobyteHD',id=2a635c4c-8c66-45d8-a600-861ace0c059d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f60c38a87af46669c8f8dd48c0cfc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:31:59Z,use_quota=True,user_id='53db073c3fcd4b269462def398282d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc062f8d-51f5-4367-a780-c973e3cb876f),volume_type_id=bc062f8d-51f5-4367-a780-c973e3cb876f)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b95da4-9ba8-44c8-b0f9-7553fcb24de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4b95da4-9ba8-44c8-b0f9-7553fcb24de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1464d8b0-355b-45d8-9d70-7bb827f474d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1464d8b0-355b-45d8-9d70-7bb827f474d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a635c4c-8c66-45d8-a600-861ace0c059d', 'volume_name': 'volume-2a635c4c-8c66-45d8-a600-861ace0c059d', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f8cdb1-672c-4e95-a49f-47f6b351b76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f8cdb1-672c-4e95-a49f-47f6b351b76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df01b607-2070-4bbc-8607-8642e7ec9412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:31:59 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Volume 2a635c4c-8c66-45d8-a600-861ace0c059d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a635c4c-8c66-45d8-a600-861ace0c059d', 'volume_size': 1} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b74e99e5-21a4-4b3c-af0c-e2cc274e7bd8,created_at=2026-09-29T14:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1679723824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b74e99e5-21a4-4b3c-af0c-e2cc274e7bd8,host='devstack@QuobyteHD#QuobyteHD',id=2a635c4c-8c66-45d8-a600-861ace0c059d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f60c38a87af46669c8f8dd48c0cfc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:31:59Z,use_quota=True,user_id='53db073c3fcd4b269462def398282d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc062f8d-51f5-4367-a780-c973e3cb876f),volume_type_id=bc062f8d-51f5-4367-a780-c973e3cb876f)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Creating volume 2a635c4c-8c66-45d8-a600-861ace0c059d {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:31:59 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:31:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2a635c4c-8c66-45d8-a600-861ace0c059d 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:31:59 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2a635c4c-8c66-45d8-a600-861ace0c059d 1073741824 Sep 29 16:31:59 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:00 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2a635c4c-8c66-45d8-a600-861ace0c059d 1073741824" returned: 0 in 0.680s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2a635c4c-8c66-45d8-a600-861ace0c059d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:00 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2a635c4c-8c66-45d8-a600-861ace0c059d Sep 29 16:32:00 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:00 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2a635c4c-8c66-45d8-a600-861ace0c059d" returned: 0 in 0.354s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:32:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:00 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df01b607-2070-4bbc-8607-8642e7ec9412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a635c4c-8c66-45d8-a600-861ace0c059d', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:00 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874ab941-f8cd-472c-a48a-bd18f38a02da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:00 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Volume volume-2a635c4c-8c66-45d8-a600-861ace0c059d (2a635c4c-8c66-45d8-a600-861ace0c059d): created successfully Sep 29 16:32:00 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874ab941-f8cd-472c-a48a-bd18f38a02da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:00 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Flow 'volume_create_manager' (e83663e5-57a0-4af2-a46b-de8919f37a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:32:00 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-eaa5eb05-4dfc-4b4c-9df1-bbad4567ad86 tempest-GroupsTest-222230637 None] Created volume successfully. Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Flow 'volume_create_manager' (60113078-2e8e-43e8-9662-aba9efb0bc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da36302-6429-48a1-aa33-d90a6f40514f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da36302-6429-48a1-aa33-d90a6f40514f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1796543678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b74e99e5-21a4-4b3c-af0c-e2cc274e7bd8,host='devstack@QuobyteHD#QuobyteHD',id=d6687671-427e-45b0-9a22-8be0259bbab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f60c38a87af46669c8f8dd48c0cfc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:04Z,use_quota=True,user_id='53db073c3fcd4b269462def398282d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc062f8d-51f5-4367-a780-c973e3cb876f),volume_type_id=bc062f8d-51f5-4367-a780-c973e3cb876f)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f60791e-6901-4048-9ac1-7be46ea19a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f60791e-6901-4048-9ac1-7be46ea19a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4a4697-38a9-4910-8a65-86489a034249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4a4697-38a9-4910-8a65-86489a034249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6687671-427e-45b0-9a22-8be0259bbab5', 'volume_name': 'volume-d6687671-427e-45b0-9a22-8be0259bbab5', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e6c938-8512-48ba-8514-cd40c35372e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e6c938-8512-48ba-8514-cd40c35372e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f75d79-2247-45dc-b1ac-be70553b2cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:03 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Volume d6687671-427e-45b0-9a22-8be0259bbab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6687671-427e-45b0-9a22-8be0259bbab5', 'volume_size': 1} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b74e99e5-21a4-4b3c-af0c-e2cc274e7bd8,created_at=2026-09-29T14:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1796543678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b74e99e5-21a4-4b3c-af0c-e2cc274e7bd8,host='devstack@QuobyteHD#QuobyteHD',id=d6687671-427e-45b0-9a22-8be0259bbab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f60c38a87af46669c8f8dd48c0cfc3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:04Z,use_quota=True,user_id='53db073c3fcd4b269462def398282d2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc062f8d-51f5-4367-a780-c973e3cb876f),volume_type_id=bc062f8d-51f5-4367-a780-c973e3cb876f)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Creating volume d6687671-427e-45b0-9a22-8be0259bbab5 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:32:03 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:32:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d6687671-427e-45b0-9a22-8be0259bbab5 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:04 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d6687671-427e-45b0-9a22-8be0259bbab5 1073741824 Sep 29 16:32:04 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:04 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d6687671-427e-45b0-9a22-8be0259bbab5 1073741824" returned: 0 in 0.929s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d6687671-427e-45b0-9a22-8be0259bbab5 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:05 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d6687671-427e-45b0-9a22-8be0259bbab5 Sep 29 16:32:05 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-4b057de3-cb36-4253-8920-3b52de1d4048 req-d4319239-66a4-4c3d-babf-3d3678a534ed tempest-TaggedAttachmentsTest-664069431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:05 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d6687671-427e-45b0-9a22-8be0259bbab5" returned: 0 in 0.622s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:32:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-4b057de3-cb36-4253-8920-3b52de1d4048 req-d4319239-66a4-4c3d-babf-3d3678a534ed tempest-TaggedAttachmentsTest-664069431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.069s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-4b057de3-cb36-4253-8920-3b52de1d4048 req-d4319239-66a4-4c3d-babf-3d3678a534ed tempest-TaggedAttachmentsTest-664069431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4f75d79-2247-45dc-b1ac-be70553b2cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6687671-427e-45b0-9a22-8be0259bbab5', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45820b35-5d10-484f-bdb6-d0d9d196d89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:05 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Volume volume-d6687671-427e-45b0-9a22-8be0259bbab5 (d6687671-427e-45b0-9a22-8be0259bbab5): created successfully Sep 29 16:32:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45820b35-5d10-484f-bdb6-d0d9d196d89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Flow 'volume_create_manager' (60113078-2e8e-43e8-9662-aba9efb0bc35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:32:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-4b057de3-cb36-4253-8920-3b52de1d4048 req-d4319239-66a4-4c3d-babf-3d3678a534ed tempest-TaggedAttachmentsTest-664069431 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-3fe53f91-0ba2-400a-9b05-cfac23afa123', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6ceee36-53f2-4a18-9749-4ef2a4fd3038', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:32:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f4fb2389-576e-4d73-8524-84f7ebb80231 tempest-GroupsTest-222230637 None] Created volume successfully. Sep 29 16:32:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-4b057de3-cb36-4253-8920-3b52de1d4048 req-d4319239-66a4-4c3d-babf-3d3678a534ed tempest-TaggedAttachmentsTest-664069431 None] attachment_update completed successfully. Sep 29 16:32:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-dc7a93a5-d20d-4684-916c-b28a7831faff tempest-GroupsTest-222230637 None] Update group completed successfully. Sep 29 16:32:08 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-d29e6a44-7ad1-4a78-992d-832d82077318 tempest-GroupsTest-222230637 None] Update group completed successfully. Sep 29 16:32:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Acquiring lock "cinder-quobyte-2a635c4c-8c66-45d8-a600-861ace0c059d" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:32:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Lock "cinder-quobyte-2a635c4c-8c66-45d8-a600-861ace0c059d" acquired by "delete_volume" :: waited 0.060s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:32:11 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[27222793-828a-4ac1-af47-f590aa783ac6]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:32:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2a635c4c-8c66-45d8-a600-861ace0c059d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:11 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-32676645-4383-43f6-8f38-0d90945ae199 req-6be088d9-5428-41a6-8799-9e857b55b9dc tempest-TaggedAttachmentsTest-664069431 None] Terminate volume connection completed successfully. Sep 29 16:32:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-32676645-4383-43f6-8f38-0d90945ae199 req-6be088d9-5428-41a6-8799-9e857b55b9dc tempest-TaggedAttachmentsTest-664069431 None] Deleting attachment d6ceee36-53f2-4a18-9749-4ef2a4fd3038. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:32:11 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2a635c4c-8c66-45d8-a600-861ace0c059d Sep 29 16:32:11 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:11 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2a635c4c-8c66-45d8-a600-861ace0c059d" returned: 0 in 0.717s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2a635c4c-8c66-45d8-a600-861ace0c059d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:11 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2a635c4c-8c66-45d8-a600-861ace0c059d Sep 29 16:32:11 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:12 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2a635c4c-8c66-45d8-a600-861ace0c059d" returned: 0 in 0.538s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Lock "cinder-quobyte-2a635c4c-8c66-45d8-a600-861ace0c059d" released by "delete_volume" :: held 1.403s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:32:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Acquiring lock "cinder-quobyte-d6687671-427e-45b0-9a22-8be0259bbab5" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:32:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Lock "cinder-quobyte-d6687671-427e-45b0-9a22-8be0259bbab5" acquired by "delete_volume" :: waited 0.050s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:32:12 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[daea481b-fa71-4060-bc35-b933b86d43fb]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:32:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d6687671-427e-45b0-9a22-8be0259bbab5 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:12 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d6687671-427e-45b0-9a22-8be0259bbab5 Sep 29 16:32:12 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:13 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d6687671-427e-45b0-9a22-8be0259bbab5" returned: 0 in 0.644s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d6687671-427e-45b0-9a22-8be0259bbab5 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:13 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d6687671-427e-45b0-9a22-8be0259bbab5 Sep 29 16:32:13 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:13 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d6687671-427e-45b0-9a22-8be0259bbab5" returned: 0 in 0.593s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Lock "cinder-quobyte-d6687671-427e-45b0-9a22-8be0259bbab5" released by "delete_volume" :: held 1.427s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:32:14 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Created reservations ['503798a8-f873-421e-88a9-3f655141f611'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:32:14 devstack cinder-volume[86793]: WARNING cinder.quota [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-278898683 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-278898683, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:32:14 devstack cinder-volume[86793]: WARNING cinder.quota [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-278898683 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-278898683, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:32:14 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Created reservations ['d3157e67-9d0c-4692-b540-e0fff1e4b68f', 'd24e1bff-0c90-45f0-a0c1-a735b33bd3a8', '522a2a93-67e1-4f0b-a8b1-788484fb041f', '21b04d5b-c99d-497c-b450-baaf2725d01a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:32:14 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Created reservations ['f5c95d9c-5b84-4ef5-9a33-84d256b01ef1', '8d38ddd8-e175-4183-ac4b-f73bf1c44854', '2faa4a72-331a-4877-a95f-b8245cee4b51', 'd0228da5-106f-4146-a36d-125b04ae4cc1'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:32:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:32:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:32:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:14 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:32:14 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:15 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.511s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:15 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:32:15 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c5b91b9c-f836-4293-9e37-85a1c96cc4bc tempest-GroupsTest-222230637 None] Delete group completed successfully. Sep 29 16:32:24 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=46,cinder:UPDATE=48,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:32:24 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=52,cinder:UPDATE=47,cinder:DELETE=1,cinder:INSERT=10 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:32:32 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Flow 'volume_create_manager' (f0f6df44-d7a7-4baf-9343-d6643490ec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5af6419-c720-46d4-b5bd-523685fc9135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5af6419-c720-46d4-b5bd-523685fc9135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-768391594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce522be3-4260-4330-91c0-8a6c91eb0c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a8ecc71abb84e7fb9e59f33b51b0b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:33Z,use_quota=True,user_id='faacc8a7e59b4830bc4441a3a1344ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583305ef-0849-4d8d-ae0b-a6dc556a2478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583305ef-0849-4d8d-ae0b-a6dc556a2478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab665ff4-d875-4ac5-9a12-8e309e149f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab665ff4-d875-4ac5-9a12-8e309e149f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce522be3-4260-4330-91c0-8a6c91eb0c31', 'volume_name': 'volume-ce522be3-4260-4330-91c0-8a6c91eb0c31', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c198b188-9a1f-4ec4-9625-96620093be04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c198b188-9a1f-4ec4-9625-96620093be04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2319a176-1892-4474-9cdb-5117cadb0b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:33 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Volume ce522be3-4260-4330-91c0-8a6c91eb0c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce522be3-4260-4330-91c0-8a6c91eb0c31', 'volume_size': 1} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-768391594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce522be3-4260-4330-91c0-8a6c91eb0c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a8ecc71abb84e7fb9e59f33b51b0b85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:33Z,use_quota=True,user_id='faacc8a7e59b4830bc4441a3a1344ee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Creating volume ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:32:33 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:33 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 1073741824 Sep 29 16:32:33 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Acquiring lock "cinder-3fe53f91-0ba2-400a-9b05-cfac23afa123-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Lock "cinder-3fe53f91-0ba2-400a-9b05-cfac23afa123-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Acquiring lock "cinder-quobyte-3fe53f91-0ba2-400a-9b05-cfac23afa123" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Lock "cinder-quobyte-3fe53f91-0ba2-400a-9b05-cfac23afa123" acquired by "delete_volume" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7027d0b-eaaf-43e5-8e7f-4a6b64c46e5c]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3fe53f91-0ba2-400a-9b05-cfac23afa123 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:33 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 1073741824" returned: 0 in 0.709s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:33 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 Sep 29 16:32:33 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:33 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3fe53f91-0ba2-400a-9b05-cfac23afa123 Sep 29 16:32:33 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:34 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31" returned: 0 in 0.398s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2319a176-1892-4474-9cdb-5117cadb0b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce522be3-4260-4330-91c0-8a6c91eb0c31', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84d6733-a929-4e51-b376-361dbf22b2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:34 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Volume volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 (ce522be3-4260-4330-91c0-8a6c91eb0c31): created successfully Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b84d6733-a929-4e51-b376-361dbf22b2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Flow 'volume_create_manager' (f0f6df44-d7a7-4baf-9343-d6643490ec24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:32:34 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3fe53f91-0ba2-400a-9b05-cfac23afa123" returned: 0 in 0.582s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3fe53f91-0ba2-400a-9b05-cfac23afa123 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:34 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2b20eeb9-a1bc-463d-a4c9-94e69cb7323e tempest-SnapshotsActionsTest-497797996 None] Created volume successfully. Sep 29 16:32:34 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3fe53f91-0ba2-400a-9b05-cfac23afa123 Sep 29 16:32:34 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:32:34 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3fe53f91-0ba2-400a-9b05-cfac23afa123" returned: 0 in 0.483s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:34 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:32:34 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Lock "cinder-quobyte-3fe53f91-0ba2-400a-9b05-cfac23afa123" released by "delete_volume" :: held 1.149s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:32:34 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Created reservations ['2adfa3d5-2412-45ac-9185-68758e697900', 'ea975262-7162-4baf-9c76-147f3f9f2b05', 'ca70aa2f-bca1-445c-a053-b07f74cd2586', '76bcca87-2679-436d-a55c-1b80e91fdb94'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:35 devstack sudo[89534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:32:35 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:35 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] Creating offline snapshot acf2320b-045b-4354-bdbc-59a87a0e1ee8 of volume ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:32:35 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.425s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.846s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f68352-448a-4f77-b241-1ee4d1e560ab]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:35 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Deleted volume successfully. Sep 29 16:32:35 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2cbe670f-06bf-498a-a603-6407109e34f5 tempest-TaggedAttachmentsTest-664069431 None] Lock "cinder-3fe53f91-0ba2-400a-9b05-cfac23afa123-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:32:35 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 Sep 29 16:32:35 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:36 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31" returned: 0 in 0.956s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:36 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 1G Sep 29 16:32:36 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:36 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:32:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Flow 'volume_create_manager' (c6899c4e-e052-468e-9ef6-7a73efcf8c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:32:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5716dcb1-f0b1-4575-b057-68fa85c461f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5716dcb1-f0b1-4575-b057-68fa85c461f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1959151009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a48157f-c74d-49a2-a6b0-1d5517150eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef367956df524d5c95f86fd6490b70dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:37Z,use_quota=True,user_id='2e71f3a041f14d7f8d4d2a9bb5838f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c015b2-200a-4302-95a6-81ddafce33ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c015b2-200a-4302-95a6-81ddafce33ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb60288-23f1-4497-aae6-c36dd2ff3b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb60288-23f1-4497-aae6-c36dd2ff3b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a48157f-c74d-49a2-a6b0-1d5517150eab', 'volume_name': 'volume-7a48157f-c74d-49a2-a6b0-1d5517150eab', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e524fe-2eb9-4ac8-8685-329f41d4db7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e524fe-2eb9-4ac8-8685-329f41d4db7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5587d01c-4496-426d-b10b-4fca396c295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:37 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Volume 7a48157f-c74d-49a2-a6b0-1d5517150eab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a48157f-c74d-49a2-a6b0-1d5517150eab', 'volume_size': 1} Sep 29 16:32:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:37 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 1G" returned: 0 in 1.030s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:37 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 Sep 29 16:32:37 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:38 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8" returned: 0 in 0.815s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:38 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 is being set with open permissions: ugo+rw Sep 29 16:32:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:38 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 Sep 29 16:32:38 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:39 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8" returned: 0 in 0.660s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:39 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.info Sep 29 16:32:39 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:39 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.info" returned: 0 in 0.381s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:39 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.info is being set with open permissions: ugo+rw Sep 29 16:32:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:39 devstack sudo[89645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.info Sep 29 16:32:39 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:40 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.info" returned: 0 in 0.564s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.634s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.970s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:40 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1959151009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a48157f-c74d-49a2-a6b0-1d5517150eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef367956df524d5c95f86fd6490b70dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:37Z,use_quota=True,user_id='2e71f3a041f14d7f8d4d2a9bb5838f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:32:40 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Creating volume 7a48157f-c74d-49a2-a6b0-1d5517150eab {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:32:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:40 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:32:40 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:32:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:40 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:32:40 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:32:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7a48157f-c74d-49a2-a6b0-1d5517150eab 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:40 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7a48157f-c74d-49a2-a6b0-1d5517150eab 1073741824 Sep 29 16:32:40 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:40 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-6960b52e-c5bd-4d39-95ad-7e048495c55c tempest-SnapshotsActionsTest-497797996 None] Create snapshot completed successfully Sep 29 16:32:41 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7a48157f-c74d-49a2-a6b0-1d5517150eab 1073741824" returned: 0 in 0.787s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7a48157f-c74d-49a2-a6b0-1d5517150eab {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:41 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7a48157f-c74d-49a2-a6b0-1d5517150eab Sep 29 16:32:41 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:41 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7a48157f-c74d-49a2-a6b0-1d5517150eab" returned: 0 in 0.555s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:32:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5587d01c-4496-426d-b10b-4fca396c295d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a48157f-c74d-49a2-a6b0-1d5517150eab', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7236265b-e1cb-428f-9268-a6b50ebbd061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:41 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Volume volume-7a48157f-c74d-49a2-a6b0-1d5517150eab (7a48157f-c74d-49a2-a6b0-1d5517150eab): created successfully Sep 29 16:32:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7236265b-e1cb-428f-9268-a6b50ebbd061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Flow 'volume_create_manager' (c6899c4e-e052-468e-9ef6-7a73efcf8c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:32:41 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-85bdd80a-2aeb-40c7-b328-cbaefcc8c2a0 tempest-ServerRescueNegativeTestJSON-1631103027 None] Created volume successfully. Sep 29 16:32:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] Creating offline snapshot 13ff5e7a-7338-4132-8ec4-73c0f5ead044 of volume ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:32:42 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a726df42-8a6f-4767-be43-dc185cfe030b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:32:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:42 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 Sep 29 16:32:42 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:43 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8" returned: 0 in 0.921s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce522be3-4260-4330-91c0-8a6c91eb0c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:43 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 1G Sep 29 16:32:43 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Flow 'volume_create_manager' (60df5566-4d37-4b1a-88e8-7b29d80f70e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b6867cb-0f02-4376-8f2e-e2c312d789a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b6867cb-0f02-4376-8f2e-e2c312d789a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-811722473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c867b923-ad35-4f16-9844-da2180625205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e6a529e4244ed28bbc056748c01f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:44Z,use_quota=True,user_id='021ce9883e1e441d84a1d2d87860bd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384c4497-3d42-49a1-97b8-fac6c894dd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384c4497-3d42-49a1-97b8-fac6c894dd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4fbf32-5361-41e8-9f83-f84167a1e4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4fbf32-5361-41e8-9f83-f84167a1e4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c867b923-ad35-4f16-9844-da2180625205', 'volume_name': 'volume-c867b923-ad35-4f16-9844-da2180625205', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a8754f-5d65-43ec-a9b1-4627e008aed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a8754f-5d65-43ec-a9b1-4627e008aed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3973f02a-96ae-427f-bc33-a0b79833e290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:43 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Volume c867b923-ad35-4f16-9844-da2180625205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c867b923-ad35-4f16-9844-da2180625205', 'volume_size': 1} Sep 29 16:32:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:44 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 1G" returned: 0 in 1.230s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:44 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 Sep 29 16:32:44 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:45 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044" returned: 0 in 0.611s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:45 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 is being set with open permissions: ugo+rw Sep 29 16:32:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:45 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 Sep 29 16:32:45 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:45 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044" returned: 0 in 0.578s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.588s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.946s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-811722473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c867b923-ad35-4f16-9844-da2180625205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e6a529e4244ed28bbc056748c01f58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:32:44Z,use_quota=True,user_id='021ce9883e1e441d84a1d2d87860bd43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:32:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Creating volume c867b923-ad35-4f16-9844-da2180625205 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:32:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:32:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:32:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:32:45 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:32:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c867b923-ad35-4f16-9844-da2180625205 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:46 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c867b923-ad35-4f16-9844-da2180625205 1073741824 Sep 29 16:32:46 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:46 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-32a70a21-7464-494f-b18b-13297c03e058 tempest-SnapshotsActionsTest-497797996 None] Create snapshot completed successfully Sep 29 16:32:46 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c867b923-ad35-4f16-9844-da2180625205 1073741824" returned: 0 in 0.932s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c867b923-ad35-4f16-9844-da2180625205 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:47 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c867b923-ad35-4f16-9844-da2180625205 Sep 29 16:32:47 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Acquiring lock "cinder-13ff5e7a-7338-4132-8ec4-73c0f5ead044-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-13ff5e7a-7338-4132-8ec4-73c0f5ead044-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Acquiring lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Acquiring lock "cinder-quobyte-13ff5e7a-7338-4132-8ec4-73c0f5ead044" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-13ff5e7a-7338-4132-8ec4-73c0f5ead044" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Deleting offline snapshot 13ff5e7a-7338-4132-8ec4-73c0f5ead044 of volume ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] snapshot_file for this snap is: volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8580ef21-44d1-4ce9-af93-92a7a1640d42]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:47 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c867b923-ad35-4f16-9844-da2180625205" returned: 0 in 0.510s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:47 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 Sep 29 16:32:47 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3973f02a-96ae-427f-bc33-a0b79833e290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c867b923-ad35-4f16-9844-da2180625205', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2d90df-66cd-4ce4-9842-e3b04f2aea6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:32:47 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Volume volume-c867b923-ad35-4f16-9844-da2180625205 (c867b923-ad35-4f16-9844-da2180625205): created successfully Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e2d90df-66cd-4ce4-9842-e3b04f2aea6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:32:47 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Flow 'volume_create_manager' (60df5566-4d37-4b1a-88e8-7b29d80f70e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:32:47 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-8b0f00ad-be88-4be7-a1ed-b2773fcc057d tempest-VolumesAdminNegativeTest-1805645450 None] Created volume successfully. Sep 29 16:32:47 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044" returned: 0 in 0.745s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce522be3-4260-4330-91c0-8a6c91eb0c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:32:48 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1e9321-3901-4ed8-acc2-3b4643103249]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:32:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:48 devstack sudo[89761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 Sep 29 16:32:48 devstack sudo[89761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:48 devstack sudo[89761]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8" returned: 0 in 0.576s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce522be3-4260-4330-91c0-8a6c91eb0c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:32:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:48 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 Sep 29 16:32:48 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Acquiring lock "cinder-c867b923-ad35-4f16-9844-da2180625205-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:32:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Lock "cinder-c867b923-ad35-4f16-9844-da2180625205-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:32:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Acquiring lock "cinder-quobyte-c867b923-ad35-4f16-9844-da2180625205" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:32:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Lock "cinder-quobyte-c867b923-ad35-4f16-9844-da2180625205" acquired by "delete_volume" :: waited 0.049s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:32:49 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca9a6a9-f27d-478f-a4a0-a513b63e85ff]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:32:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c867b923-ad35-4f16-9844-da2180625205 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:49 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c867b923-ad35-4f16-9844-da2180625205 Sep 29 16:32:49 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:49 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044" returned: 0 in 0.846s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:49 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044 Sep 29 16:32:49 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:49 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c867b923-ad35-4f16-9844-da2180625205" returned: 0 in 0.787s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c867b923-ad35-4f16-9844-da2180625205 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:49 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c867b923-ad35-4f16-9844-da2180625205 Sep 29 16:32:49 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:49 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.13ff5e7a-7338-4132-8ec4-73c0f5ead044" returned: 0 in 0.422s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-13ff5e7a-7338-4132-8ec4-73c0f5ead044" released by "_delete_snapshot" :: held 2.761s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:32:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" released by "delete_snapshot" :: held 2.810s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:32:50 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Created reservations ['ce27b4fb-d14e-485e-ad1b-88809c3a8547', 'cf05cec4-9b28-46a5-b447-7d0c9b58a129', 'cf5dc84a-6a77-42e1-8b5a-e95d2bb2c057', '82cf5950-9494-49b0-b39a-651da0ab2324'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:32:50 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Delete snapshot completed successfully. Sep 29 16:32:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-819235ce-33df-42a5-b145-b7fd1ed5fa80 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-13ff5e7a-7338-4132-8ec4-73c0f5ead044-delete_snapshot" released by "delete_snapshot" :: held 3.238s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:32:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c867b923-ad35-4f16-9844-da2180625205" returned: 0 in 0.726s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:50 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Lock "cinder-quobyte-c867b923-ad35-4f16-9844-da2180625205" released by "delete_volume" :: held 1.678s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:32:50 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Created reservations ['77565de3-e87a-4986-8773-0add5c738cc1', '0f7f35ec-38fb-4b70-a5ad-1a07fb99aa3e', '7c301654-0fb8-4886-8126-16e75cccdeb1', '6a610aa3-0038-4e78-a2bb-87a56eef47e5'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:32:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:32:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:32:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:51 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:32:51 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] Creating offline snapshot a4edcf37-9014-4ac8-997d-e9fa60f9443b of volume ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:32:51 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.583s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:51 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:32:51 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Deleted volume successfully. Sep 29 16:32:51 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7fe4d8-0483-453e-b997-bd48b57bc01e]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:32:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d2a1c4b3-a6e9-47ee-94d4-e272b5d9b7f6 tempest-VolumesAdminNegativeTest-1805645450 None] Lock "cinder-c867b923-ad35-4f16-9844-da2180625205-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:32:52 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 Sep 29 16:32:52 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:52 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8" returned: 0 in 0.924s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce522be3-4260-4330-91c0-8a6c91eb0c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:32:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:52 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b 1G Sep 29 16:32:52 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:53 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b 1G" returned: 0 in 0.763s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:53 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b Sep 29 16:32:53 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:53 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b" returned: 0 in 0.442s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:53 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b is being set with open permissions: ugo+rw Sep 29 16:32:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:53 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b Sep 29 16:32:53 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:54 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b" returned: 0 in 0.501s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.959s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:32:54 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-df35befc-a937-43c8-95ee-9c5ba1181757 tempest-SnapshotsActionsTest-497797996 None] Create snapshot completed successfully Sep 29 16:32:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Acquiring lock "cinder-a4edcf37-9014-4ac8-997d-e9fa60f9443b-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:32:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-a4edcf37-9014-4ac8-997d-e9fa60f9443b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:32:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Acquiring lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:32:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:32:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Acquiring lock "cinder-quobyte-a4edcf37-9014-4ac8-997d-e9fa60f9443b" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:32:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-a4edcf37-9014-4ac8-997d-e9fa60f9443b" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:32:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Deleting offline snapshot a4edcf37-9014-4ac8-997d-e9fa60f9443b of volume ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:32:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] snapshot_file for this snap is: volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:32:55 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1b38a1-17b5-4f50-b8ec-e76252631e81]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:32:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:55 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b Sep 29 16:32:55 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:55 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b" returned: 0 in 0.472s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce522be3-4260-4330-91c0-8a6c91eb0c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:32:55 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[38306217-c4b5-4930-a125-c3a5ad567cee]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:32:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:55 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 Sep 29 16:32:55 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:56 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8" returned: 0 in 0.617s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce522be3-4260-4330-91c0-8a6c91eb0c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:32:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:56 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b Sep 29 16:32:56 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:56 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b" returned: 0 in 0.555s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:56 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b Sep 29 16:32:56 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:57 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.a4edcf37-9014-4ac8-997d-e9fa60f9443b" returned: 0 in 0.486s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-a4edcf37-9014-4ac8-997d-e9fa60f9443b" released by "_delete_snapshot" :: held 2.332s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:32:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" released by "delete_snapshot" :: held 2.393s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:32:57 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Created reservations ['0d972194-a03f-49f1-9e56-1eb34dc49267', '79a65b32-4d14-43b0-a9bf-ae918e08f996', '9c72f4bb-c0cc-4cb8-b3f0-31169d965737', '15327517-730b-4ee9-af1c-eefcf179d29c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:32:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Delete snapshot completed successfully. Sep 29 16:32:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4e4ce723-828f-47e1-a4ae-1acb25abdf7a tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-a4edcf37-9014-4ac8-997d-e9fa60f9443b-delete_snapshot" released by "delete_snapshot" :: held 2.646s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:32:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:32:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:32:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] Creating offline snapshot afb1558d-2ef6-41cf-8d8c-92a89481877c of volume ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:32:58 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[db69d541-9f9d-4582-b69b-2c025a9aaac5]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:32:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:59 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 Sep 29 16:32:59 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:59 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Sep 29 16:32:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8" returned: 0 in 0.602s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:32:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce522be3-4260-4330-91c0-8a6c91eb0c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:32:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:32:59 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c 1G Sep 29 16:32:59 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:32:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Acquiring lock "cinder-7a48157f-c74d-49a2-a6b0-1d5517150eab-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Lock "cinder-7a48157f-c74d-49a2-a6b0-1d5517150eab-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Acquiring lock "cinder-quobyte-7a48157f-c74d-49a2-a6b0-1d5517150eab" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Lock "cinder-quobyte-7a48157f-c74d-49a2-a6b0-1d5517150eab" acquired by "delete_volume" :: waited 0.047s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:00 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e6c39c-a16b-43ad-88e7-bb70c159a964]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:33:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7a48157f-c74d-49a2-a6b0-1d5517150eab {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:00 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c 1G" returned: 0 in 0.901s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:00 devstack sudo[89939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7a48157f-c74d-49a2-a6b0-1d5517150eab Sep 29 16:33:00 devstack sudo[89939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:00 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c Sep 29 16:33:00 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:00 devstack sudo[89939]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7a48157f-c74d-49a2-a6b0-1d5517150eab" returned: 0 in 0.474s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7a48157f-c74d-49a2-a6b0-1d5517150eab {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:00 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7a48157f-c74d-49a2-a6b0-1d5517150eab Sep 29 16:33:00 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:00 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c" returned: 0 in 0.611s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:00 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c is being set with open permissions: ugo+rw Sep 29 16:33:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:00 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c Sep 29 16:33:00 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:01 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7a48157f-c74d-49a2-a6b0-1d5517150eab" returned: 0 in 0.384s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Lock "cinder-quobyte-7a48157f-c74d-49a2-a6b0-1d5517150eab" released by "delete_volume" :: held 0.948s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:01 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Created reservations ['9c03428a-fbf7-48c8-8b07-d417c6948d89', '3ce30134-70bf-406b-9551-2bb7285aa096', 'b06f84cd-f011-4b3c-91b0-465efb083b0c', '4f6f8e39-f85b-4486-9096-5aaebb9125ce'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:33:01 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:33:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:33:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:33:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:33:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:33:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c" returned: 0 in 0.392s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:01 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:33:01 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.726s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:33:01 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-851041c4-b74f-4986-a264-d2ebf988f925 tempest-SnapshotsActionsTest-497797996 None] Create snapshot completed successfully Sep 29 16:33:01 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.526s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:01 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:33:01 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Deleted volume successfully. Sep 29 16:33:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-75ee0c6c-eb26-4a52-b59d-1f96a688c718 tempest-ServerRescueNegativeTestJSON-1631103027 None] Lock "cinder-7a48157f-c74d-49a2-a6b0-1d5517150eab-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Acquiring lock "cinder-afb1558d-2ef6-41cf-8d8c-92a89481877c-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-afb1558d-2ef6-41cf-8d8c-92a89481877c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Acquiring lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Acquiring lock "cinder-quobyte-afb1558d-2ef6-41cf-8d8c-92a89481877c" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-afb1558d-2ef6-41cf-8d8c-92a89481877c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Deleting offline snapshot afb1558d-2ef6-41cf-8d8c-92a89481877c of volume ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:33:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] snapshot_file for this snap is: volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:33:02 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[91550fd9-fafe-4593-abfb-a60e88621451]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:33:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:02 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c Sep 29 16:33:02 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:03 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c" returned: 0 in 0.906s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce522be3-4260-4330-91c0-8a6c91eb0c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:33:03 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac930d1-2969-4483-afa2-8a94050d0d81]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:33:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:03 devstack sudo[89976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 Sep 29 16:33:03 devstack sudo[89976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:04 devstack sudo[89976]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8" returned: 0 in 0.809s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce522be3-4260-4330-91c0-8a6c91eb0c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:33:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:04 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c Sep 29 16:33:04 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:04 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c" returned: 0 in 0.603s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:04 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c Sep 29 16:33:04 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:05 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.afb1558d-2ef6-41cf-8d8c-92a89481877c" returned: 0 in 0.430s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-afb1558d-2ef6-41cf-8d8c-92a89481877c" released by "_delete_snapshot" :: held 2.923s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" released by "delete_snapshot" :: held 2.963s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:05 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Created reservations ['d1b626ee-f66e-4581-96a0-8aab9ff84a49', '0efb8cf1-b755-403f-9183-d273144208a9', '2fc235fd-a867-4948-8ed3-468d01029c63', 'c06b14b2-c74a-4875-8087-8039fb7bab79'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:33:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Delete snapshot completed successfully. Sep 29 16:33:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4c5d2a22-c8ad-4b33-9d45-144830229d24 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-afb1558d-2ef6-41cf-8d8c-92a89481877c-delete_snapshot" released by "delete_snapshot" :: held 3.175s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:33:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:33:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] Creating offline snapshot 4428fe3a-313b-418c-9d9e-32c4232b30ad of volume ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:33:06 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7140794-d2c6-4d8a-a32f-05f1faed2874]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:33:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:06 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 Sep 29 16:33:06 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:06 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8" returned: 0 in 0.663s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce522be3-4260-4330-91c0-8a6c91eb0c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:33:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:06 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad 1G Sep 29 16:33:06 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:07 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad 1G" returned: 0 in 0.704s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:07 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad Sep 29 16:33:07 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:07 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad" returned: 0 in 0.438s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:07 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad is being set with open permissions: ugo+rw Sep 29 16:33:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:07 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad Sep 29 16:33:07 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:08 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad" returned: 0 in 0.462s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.431s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:33:08 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-599be6d2-506e-4b65-84e6-92fa3f7fe38c tempest-SnapshotsActionsTest-497797996 None] Create snapshot completed successfully Sep 29 16:33:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Acquiring lock "cinder-4428fe3a-313b-418c-9d9e-32c4232b30ad-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-4428fe3a-313b-418c-9d9e-32c4232b30ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Acquiring lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Acquiring lock "cinder-quobyte-4428fe3a-313b-418c-9d9e-32c4232b30ad" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-4428fe3a-313b-418c-9d9e-32c4232b30ad" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:09 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Deleting offline snapshot 4428fe3a-313b-418c-9d9e-32c4232b30ad of volume ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:33:09 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] snapshot_file for this snap is: volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:33:09 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb6c4e5-2966-470b-a28f-a5afa8afd58d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:33:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:09 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad Sep 29 16:33:09 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:09 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad" returned: 0 in 0.436s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:09 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce522be3-4260-4330-91c0-8a6c91eb0c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:33:09 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[716cb510-dfab-4956-9904-66e2de21962e]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:33:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:09 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 Sep 29 16:33:09 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:10 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8" returned: 0 in 0.527s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce522be3-4260-4330-91c0-8a6c91eb0c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:33:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:10 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad Sep 29 16:33:10 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:10 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad" returned: 0 in 0.504s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:10 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad Sep 29 16:33:10 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:11 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.4428fe3a-313b-418c-9d9e-32c4232b30ad" returned: 0 in 0.275s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-4428fe3a-313b-418c-9d9e-32c4232b30ad" released by "_delete_snapshot" :: held 1.877s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" released by "delete_snapshot" :: held 1.905s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:11 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Created reservations ['7daec648-1fdd-4e09-8347-41839fe331da', '9ad59173-880a-4f7c-ae88-27d07fabc4dd', '06f1215d-2569-491c-8194-be2d44712e84', 'c93a4be5-2104-4f3f-a891-ef9e108ef201'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:33:11 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Delete snapshot completed successfully. Sep 29 16:33:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e1cc8eeb-4c18-4c0c-8a1e-49527573eef2 tempest-SnapshotsActionsTest-248806063 None] Lock "cinder-4428fe3a-313b-418c-9d9e-32c4232b30ad-delete_snapshot" released by "delete_snapshot" :: held 2.148s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Acquiring lock "cinder-acf2320b-045b-4354-bdbc-59a87a0e1ee8-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Lock "cinder-acf2320b-045b-4354-bdbc-59a87a0e1ee8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Acquiring lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Acquiring lock "cinder-quobyte-acf2320b-045b-4354-bdbc-59a87a0e1ee8" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Lock "cinder-quobyte-acf2320b-045b-4354-bdbc-59a87a0e1ee8" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Deleting offline snapshot acf2320b-045b-4354-bdbc-59a87a0e1ee8 of volume ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:33:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] snapshot_file for this snap is: volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:33:12 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[624d5813-215f-4b5d-8185-384c9e64738c]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:33:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:12 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 Sep 29 16:33:12 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:12 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8" returned: 0 in 0.406s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce522be3-4260-4330-91c0-8a6c91eb0c31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:33:12 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2031a0-0dfc-4170-96f6-c4992c44ed33]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:33:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:12 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 Sep 29 16:33:12 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:13 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31" returned: 0 in 0.544s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:13 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 Sep 29 16:33:13 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:13 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8" returned: 0 in 0.463s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:13 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8 Sep 29 16:33:13 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:14 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31.acf2320b-045b-4354-bdbc-59a87a0e1ee8" returned: 0 in 0.348s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Lock "cinder-quobyte-acf2320b-045b-4354-bdbc-59a87a0e1ee8" released by "_delete_snapshot" :: held 1.931s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" released by "delete_snapshot" :: held 1.973s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:14 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Created reservations ['a04f7a9b-0e6b-4730-bf24-61a09d3c1a36', '3e30ba62-f808-4ccd-9574-8827bc699726', 'efca5651-5966-43c3-bc0b-6cbca87288d2', '13d670d1-a70d-4362-8199-c7db5037329c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:33:14 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Delete snapshot completed successfully. Sep 29 16:33:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-beeb7aef-11f2-4787-b962-f6dcb36fa959 tempest-SnapshotsActionsTest-497797996 None] Lock "cinder-acf2320b-045b-4354-bdbc-59a87a0e1ee8-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Acquiring lock "cinder-ce522be3-4260-4330-91c0-8a6c91eb0c31-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Lock "cinder-ce522be3-4260-4330-91c0-8a6c91eb0c31-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Acquiring lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:15 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d488700-5fdb-460a-bff7-d40876855dab]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:33:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:15 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 Sep 29 16:33:15 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:16 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31" returned: 0 in 0.549s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:16 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31 Sep 29 16:33:16 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:16 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce522be3-4260-4330-91c0-8a6c91eb0c31" returned: 0 in 0.316s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Lock "cinder-quobyte-ce522be3-4260-4330-91c0-8a6c91eb0c31" released by "delete_volume" :: held 0.976s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:16 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Created reservations ['281937a4-5cd0-4d15-ac46-f754d5da17d2', '81d53164-cca6-4ba7-99df-964e4a7f84dc', 'd72e78d9-44ff-4148-bff2-3f14be5fbf56', '1cc20188-4458-4794-8c62-1a587044e09f'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:33:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:33:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:33:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:33:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:33:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:33:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:16 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:33:16 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:17 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.299s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:17 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:33:17 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Deleted volume successfully. Sep 29 16:33:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-42748d92-8b88-407f-af9f-9c5ccd696b14 tempest-SnapshotsActionsTest-497797996 None] Lock "cinder-ce522be3-4260-4330-91c0-8a6c91eb0c31-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:26 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=72,cinder:SELECT=59,cinder:INSERT=26,cinder:DELETE=6 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:33:27 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=67,cinder:UPDATE=76,cinder:INSERT=14,cinder:DELETE=6 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:33:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:33:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:33:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:33:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:33:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:33:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:33:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:34 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:33:34 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:35 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.302s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:33:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:33:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 9 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:33:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Flow 'volume_create_manager' (3ad09e69-009c-4301-9e77-9a462ba625ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8685b8-03f8-424e-bd26-75aad6d92ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8685b8-03f8-424e-bd26-75aad6d92ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-246534206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4534006f-7e6c-433a-b2f3-56a4924349bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e042a44f19ca4511b00b5d00ac8264c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:33:47Z,use_quota=True,user_id='b93a66175f5342b8a2ca4c0539146135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9000ef-b822-42e0-834e-43cb5572ac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9000ef-b822-42e0-834e-43cb5572ac68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97dd3619-048f-4676-94ee-f82dd675f706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97dd3619-048f-4676-94ee-f82dd675f706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4534006f-7e6c-433a-b2f3-56a4924349bc', 'volume_name': 'volume-4534006f-7e6c-433a-b2f3-56a4924349bc', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a6656f-997d-4239-b593-673b9338049b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a6656f-997d-4239-b593-673b9338049b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256cb994-7536-43a7-ae98-490807988935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:33:46 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Volume 4534006f-7e6c-433a-b2f3-56a4924349bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4534006f-7e6c-433a-b2f3-56a4924349bc', 'volume_size': 1} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-246534206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4534006f-7e6c-433a-b2f3-56a4924349bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e042a44f19ca4511b00b5d00ac8264c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:33:47Z,use_quota=True,user_id='b93a66175f5342b8a2ca4c0539146135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Creating volume 4534006f-7e6c-433a-b2f3-56a4924349bc {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:33:46 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:33:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4534006f-7e6c-433a-b2f3-56a4924349bc 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:46 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4534006f-7e6c-433a-b2f3-56a4924349bc 1073741824 Sep 29 16:33:46 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:47 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4534006f-7e6c-433a-b2f3-56a4924349bc 1073741824" returned: 0 in 0.833s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4534006f-7e6c-433a-b2f3-56a4924349bc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:47 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4534006f-7e6c-433a-b2f3-56a4924349bc Sep 29 16:33:47 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:48 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4534006f-7e6c-433a-b2f3-56a4924349bc" returned: 0 in 0.529s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:33:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:33:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256cb994-7536-43a7-ae98-490807988935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4534006f-7e6c-433a-b2f3-56a4924349bc', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:33:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e104e6-a3be-45d1-b23f-2e60fcb680fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:33:48 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Volume volume-4534006f-7e6c-433a-b2f3-56a4924349bc (4534006f-7e6c-433a-b2f3-56a4924349bc): created successfully Sep 29 16:33:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e104e6-a3be-45d1-b23f-2e60fcb680fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:33:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Flow 'volume_create_manager' (3ad09e69-009c-4301-9e77-9a462ba625ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:33:48 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-572cad2a-65e1-4183-adb2-96af08e0a590 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Created volume successfully. Sep 29 16:33:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Acquiring lock "cinder-4534006f-7e6c-433a-b2f3-56a4924349bc-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Lock "cinder-4534006f-7e6c-433a-b2f3-56a4924349bc-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Acquiring lock "cinder-quobyte-4534006f-7e6c-433a-b2f3-56a4924349bc" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Lock "cinder-quobyte-4534006f-7e6c-433a-b2f3-56a4924349bc" acquired by "delete_volume" :: waited 0.035s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:49 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9063cfd2-20d1-4f49-8413-11c6b87298c4]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:33:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4534006f-7e6c-433a-b2f3-56a4924349bc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:49 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4534006f-7e6c-433a-b2f3-56a4924349bc Sep 29 16:33:49 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:49 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4534006f-7e6c-433a-b2f3-56a4924349bc" returned: 0 in 0.474s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4534006f-7e6c-433a-b2f3-56a4924349bc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:49 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4534006f-7e6c-433a-b2f3-56a4924349bc Sep 29 16:33:49 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:50 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4534006f-7e6c-433a-b2f3-56a4924349bc" returned: 0 in 0.276s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Lock "cinder-quobyte-4534006f-7e6c-433a-b2f3-56a4924349bc" released by "delete_volume" :: held 0.820s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:50 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Created reservations ['4bb95a20-6d0a-4896-9417-19a1fb4356a5', '7e4f5706-1255-4832-bc29-a8cb65ab99f8', 'bfd5f3da-fe6f-4a06-87be-eb6a6d4d52e6', '43130779-cd89-4cf0-9de2-e11e3ee8cf40'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:33:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:33:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:33:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:33:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:33:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:33:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:50 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:33:50 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:50 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.596s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:50 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:33:50 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Deleted volume successfully. Sep 29 16:33:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c919295b-9dd4-4923-8aba-52b5ef02df59 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Lock "cinder-4534006f-7e6c-433a-b2f3-56a4924349bc-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Flow 'volume_create_manager' (561fc09b-1462-4adc-93c5-dc6ca42d6710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b91d563-b3cd-4dda-a77b-f050361d15b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b91d563-b3cd-4dda-a77b-f050361d15b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-543017171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af517f4-1e98-476d-852f-94ec9b75b4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e042a44f19ca4511b00b5d00ac8264c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:33:51Z,use_quota=True,user_id='b93a66175f5342b8a2ca4c0539146135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e15d648-bcbc-458f-bb4c-26e5f1dbc7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e15d648-bcbc-458f-bb4c-26e5f1dbc7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ead237d-2f8a-47ef-8c66-82126b9f3c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ead237d-2f8a-47ef-8c66-82126b9f3c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af517f4-1e98-476d-852f-94ec9b75b4ec', 'volume_name': 'volume-6af517f4-1e98-476d-852f-94ec9b75b4ec', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b03eb3-1a87-4140-8f27-c03152e546ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b03eb3-1a87-4140-8f27-c03152e546ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772f5534-30f5-4d49-80f5-427592cc8a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:33:51 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Volume 6af517f4-1e98-476d-852f-94ec9b75b4ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af517f4-1e98-476d-852f-94ec9b75b4ec', 'volume_size': 1} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-543017171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af517f4-1e98-476d-852f-94ec9b75b4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e042a44f19ca4511b00b5d00ac8264c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:33:51Z,use_quota=True,user_id='b93a66175f5342b8a2ca4c0539146135',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Creating volume 6af517f4-1e98-476d-852f-94ec9b75b4ec {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:33:51 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:33:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6af517f4-1e98-476d-852f-94ec9b75b4ec 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:51 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6af517f4-1e98-476d-852f-94ec9b75b4ec 1073741824 Sep 29 16:33:51 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:52 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6af517f4-1e98-476d-852f-94ec9b75b4ec 1073741824" returned: 0 in 0.610s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6af517f4-1e98-476d-852f-94ec9b75b4ec {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:52 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6af517f4-1e98-476d-852f-94ec9b75b4ec Sep 29 16:33:52 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:52 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6af517f4-1e98-476d-852f-94ec9b75b4ec" returned: 0 in 0.427s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:33:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:33:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772f5534-30f5-4d49-80f5-427592cc8a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af517f4-1e98-476d-852f-94ec9b75b4ec', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:33:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c6b039-d612-45ce-be2e-d4ef4045543b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:33:52 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Volume volume-6af517f4-1e98-476d-852f-94ec9b75b4ec (6af517f4-1e98-476d-852f-94ec9b75b4ec): created successfully Sep 29 16:33:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c6b039-d612-45ce-be2e-d4ef4045543b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:33:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Flow 'volume_create_manager' (561fc09b-1462-4adc-93c5-dc6ca42d6710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:33:52 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b78c63fc-46f6-491f-8fa7-473e74e43f97 tempest-VolumeQuotasAdminTestJSON-1959903314 None] Created volume successfully. Sep 29 16:33:55 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f0247999-32a3-4978-85b4-ed54f705c2b0 tempest-VolumeQuotasAdminTestJSON-1770145039 None] Transfer volume completed successfully. Sep 29 16:33:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Acquiring lock "cinder-6af517f4-1e98-476d-852f-94ec9b75b4ec-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Lock "cinder-6af517f4-1e98-476d-852f-94ec9b75b4ec-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Acquiring lock "cinder-quobyte-6af517f4-1e98-476d-852f-94ec9b75b4ec" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:33:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Lock "cinder-quobyte-6af517f4-1e98-476d-852f-94ec9b75b4ec" acquired by "delete_volume" :: waited 0.042s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:33:56 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b53c7b-61b7-4aee-afff-2fac2badcf78]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:33:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6af517f4-1e98-476d-852f-94ec9b75b4ec {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:56 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6af517f4-1e98-476d-852f-94ec9b75b4ec Sep 29 16:33:56 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:57 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6af517f4-1e98-476d-852f-94ec9b75b4ec" returned: 0 in 0.778s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6af517f4-1e98-476d-852f-94ec9b75b4ec {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:57 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6af517f4-1e98-476d-852f-94ec9b75b4ec Sep 29 16:33:57 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:57 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6af517f4-1e98-476d-852f-94ec9b75b4ec" returned: 0 in 0.331s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Lock "cinder-quobyte-6af517f4-1e98-476d-852f-94ec9b75b4ec" released by "delete_volume" :: held 1.214s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:33:57 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Created reservations ['9ada2b78-5199-46e7-8863-2fbd366401af', 'a849156e-8fce-46cb-b834-812e5c104884', 'd55c0a1c-0df7-47e6-8610-99f2e2db2e37', '3d7b6d8c-35ab-4933-aee4-343bfe736fa8'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:33:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:33:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:33:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:33:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:33:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:33:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:33:57 devstack sudo[90487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:33:57 devstack sudo[90487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:33:57 devstack sudo[90487]: pam_unix(sudo:session): session closed for user root Sep 29 16:33:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.265s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:33:57 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:33:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Deleted volume successfully. Sep 29 16:33:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-abd87a28-145c-4e4c-a3e5-92cc1f60e77b tempest-VolumeQuotasAdminTestJSON-2072536176 None] Lock "cinder-6af517f4-1e98-476d-852f-94ec9b75b4ec-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:34:07 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=14,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:34:07 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=23,cinder:SELECT=15,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Flow 'volume_create_manager' (a95a505b-395f-4db4-9435-35041d327b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dcaffe3-0638-44f4-b421-016083ff6371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dcaffe3-0638-44f4-b421-016083ff6371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1908404678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c7b475-6b06-42c0-bee6-a62f56dabd80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f4a435e0b447e9eadac24855891f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:09Z,use_quota=True,user_id='23b55561146e44f1ae42189b2fcc0cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fca2b97-55e7-4270-a394-2d0ea3e7e4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fca2b97-55e7-4270-a394-2d0ea3e7e4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e995fb-bdc5-4d2b-895a-c95ed76964a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e995fb-bdc5-4d2b-895a-c95ed76964a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c7b475-6b06-42c0-bee6-a62f56dabd80', 'volume_name': 'volume-37c7b475-6b06-42c0-bee6-a62f56dabd80', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5389b741-1f08-41db-b480-cbdbf297bad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5389b741-1f08-41db-b480-cbdbf297bad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0a1c14-0415-4c26-8759-74dfa83606f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:08 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Volume 37c7b475-6b06-42c0-bee6-a62f56dabd80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c7b475-6b06-42c0-bee6-a62f56dabd80', 'volume_size': 1} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1908404678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c7b475-6b06-42c0-bee6-a62f56dabd80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f4a435e0b447e9eadac24855891f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:09Z,use_quota=True,user_id='23b55561146e44f1ae42189b2fcc0cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Creating volume 37c7b475-6b06-42c0-bee6-a62f56dabd80 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:34:08 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:34:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-37c7b475-6b06-42c0-bee6-a62f56dabd80 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:09 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-37c7b475-6b06-42c0-bee6-a62f56dabd80 1073741824 Sep 29 16:34:09 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:09 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-37c7b475-6b06-42c0-bee6-a62f56dabd80 1073741824" returned: 0 in 0.891s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-37c7b475-6b06-42c0-bee6-a62f56dabd80 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:10 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-37c7b475-6b06-42c0-bee6-a62f56dabd80 Sep 29 16:34:10 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:10 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-37c7b475-6b06-42c0-bee6-a62f56dabd80" returned: 0 in 0.511s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:34:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0a1c14-0415-4c26-8759-74dfa83606f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c7b475-6b06-42c0-bee6-a62f56dabd80', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4600f1-3f68-44a4-a09d-70b9060cfc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:10 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Volume volume-37c7b475-6b06-42c0-bee6-a62f56dabd80 (37c7b475-6b06-42c0-bee6-a62f56dabd80): created successfully Sep 29 16:34:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4600f1-3f68-44a4-a09d-70b9060cfc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Flow 'volume_create_manager' (a95a505b-395f-4db4-9435-35041d327b54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:34:10 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c0bf6589-7d48-48ee-9159-91f8e9b00f75 tempest-ServerActionsTestOtherA-418642240 None] Created volume successfully. Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Flow 'volume_create_manager' (1b345db3-e502-4774-b541-43cd364cf811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b4009f-d0cc-47ab-85f7-ccc5339e9401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b4009f-d0cc-47ab-85f7-ccc5339e9401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1026938812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821dbf51-a902-4577-9087-2d3c969eb406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d0889c9dd74bdaa9e527c3fa0a8c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:11Z,use_quota=True,user_id='5cf5e028092e4b2f935e5bebe28bb0e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6774345c-44e6-4efe-8f8e-483384f4cd6d),volume_type_id=6774345c-44e6-4efe-8f8e-483384f4cd6d)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a64f429-3e52-4ff4-a3cf-bb0130bcc4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a64f429-3e52-4ff4-a3cf-bb0130bcc4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19739c4-7fec-481c-a334-7cb5f013cfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19739c4-7fec-481c-a334-7cb5f013cfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '821dbf51-a902-4577-9087-2d3c969eb406', 'volume_name': 'volume-821dbf51-a902-4577-9087-2d3c969eb406', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e86495a-248f-4156-b38e-7bc744fd7f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e86495a-248f-4156-b38e-7bc744fd7f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d992df3-9226-49d8-b7a0-8d544113097b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:11 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Volume 821dbf51-a902-4577-9087-2d3c969eb406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-821dbf51-a902-4577-9087-2d3c969eb406', 'volume_size': 1} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1026938812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=821dbf51-a902-4577-9087-2d3c969eb406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d0889c9dd74bdaa9e527c3fa0a8c59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:11Z,use_quota=True,user_id='5cf5e028092e4b2f935e5bebe28bb0e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6774345c-44e6-4efe-8f8e-483384f4cd6d),volume_type_id=6774345c-44e6-4efe-8f8e-483384f4cd6d)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Creating volume 821dbf51-a902-4577-9087-2d3c969eb406 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:34:11 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:34:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-821dbf51-a902-4577-9087-2d3c969eb406 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:11 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-821dbf51-a902-4577-9087-2d3c969eb406 1073741824 Sep 29 16:34:11 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:12 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-821dbf51-a902-4577-9087-2d3c969eb406 1073741824" returned: 0 in 0.515s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-821dbf51-a902-4577-9087-2d3c969eb406 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:12 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-821dbf51-a902-4577-9087-2d3c969eb406 Sep 29 16:34:12 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:12 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-821dbf51-a902-4577-9087-2d3c969eb406" returned: 0 in 0.289s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:34:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d992df3-9226-49d8-b7a0-8d544113097b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-821dbf51-a902-4577-9087-2d3c969eb406', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e866eb-de99-4158-afb5-96ac8bea44eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:12 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Volume volume-821dbf51-a902-4577-9087-2d3c969eb406 (821dbf51-a902-4577-9087-2d3c969eb406): created successfully Sep 29 16:34:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e866eb-de99-4158-afb5-96ac8bea44eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Flow 'volume_create_manager' (1b345db3-e502-4774-b541-43cd364cf811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:34:12 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1b172c3c-f889-4313-9de3-1bbcd0d218e7 tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Created volume successfully. Sep 29 16:34:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b75e5ed7-43de-44ab-ac71-d2dd887ed23d tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b75e5ed7-43de-44ab-ac71-d2dd887ed23d tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b75e5ed7-43de-44ab-ac71-d2dd887ed23d tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:34:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b75e5ed7-43de-44ab-ac71-d2dd887ed23d tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:34:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b75e5ed7-43de-44ab-ac71-d2dd887ed23d tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b75e5ed7-43de-44ab-ac71-d2dd887ed23d tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:14 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:34:14 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:14 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b75e5ed7-43de-44ab-ac71-d2dd887ed23d tempest-VolumeRetypeWithoutMigrationTest-437190719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.374s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:14 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-b75e5ed7-43de-44ab-ac71-d2dd887ed23d tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:34:14 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b75e5ed7-43de-44ab-ac71-d2dd887ed23d tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Retype volume completed successfully. Sep 29 16:34:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Acquiring lock "cinder-821dbf51-a902-4577-9087-2d3c969eb406-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:34:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Lock "cinder-821dbf51-a902-4577-9087-2d3c969eb406-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:34:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Acquiring lock "cinder-quobyte-821dbf51-a902-4577-9087-2d3c969eb406" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:34:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Lock "cinder-quobyte-821dbf51-a902-4577-9087-2d3c969eb406" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:34:15 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b10cf22-7b0e-463d-9784-2c0668ec447d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:34:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-821dbf51-a902-4577-9087-2d3c969eb406 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:16 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-821dbf51-a902-4577-9087-2d3c969eb406 Sep 29 16:34:16 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:16 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-821dbf51-a902-4577-9087-2d3c969eb406" returned: 0 in 0.607s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-821dbf51-a902-4577-9087-2d3c969eb406 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:16 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-821dbf51-a902-4577-9087-2d3c969eb406 Sep 29 16:34:16 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:16 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-821dbf51-a902-4577-9087-2d3c969eb406" returned: 0 in 0.426s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Lock "cinder-quobyte-821dbf51-a902-4577-9087-2d3c969eb406" released by "delete_volume" :: held 1.164s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:34:17 devstack cinder-volume[86793]: WARNING cinder.quota [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:34:17 devstack cinder-volume[86793]: WARNING cinder.quota [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:34:17 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Created reservations ['69856d3d-f114-4538-b645-01647f4b046d', 'b07950d0-bffc-4543-bffa-900d70f62975', '20678c15-958b-405f-b582-4438b705fd2c', '19a196d9-87fc-4ee4-9265-db53f283d12f'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:34:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:34:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:34:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:17 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:34:17 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:17 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.272s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:17 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:34:17 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Deleted volume successfully. Sep 29 16:34:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d67a3390-e218-40af-8a62-e3b0f7dc9acc tempest-VolumeRetypeWithoutMigrationTest-437190719 None] Lock "cinder-821dbf51-a902-4577-9087-2d3c969eb406-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Flow 'volume_create_manager' (3e248621-b92c-4427-8bb0-fc3fa75d1565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abc58f7-2c80-4041-b1ee-fe13134774a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abc58f7-2c80-4041-b1ee-fe13134774a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2024086538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0378ce7e-f1bc-4f9a-acce-35f1b4f60425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fe216960db4a2ea3c150f98adede9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:22Z,use_quota=True,user_id='2900674461c64e13b86635b8c933eec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b15d94d8-55ba-43ef-866a-91c2a71fae64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b15d94d8-55ba-43ef-866a-91c2a71fae64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80059a15-c1ae-4e96-8f6e-10279f3a8efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80059a15-c1ae-4e96-8f6e-10279f3a8efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0378ce7e-f1bc-4f9a-acce-35f1b4f60425', 'volume_name': 'volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0286c8-10d2-4508-ad8e-6862fb257db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0286c8-10d2-4508-ad8e-6862fb257db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6790bfd3-662e-4737-ad4f-e9ab188435da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:22 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Volume 0378ce7e-f1bc-4f9a-acce-35f1b4f60425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425', 'volume_size': 1} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:34:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2024086538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0378ce7e-f1bc-4f9a-acce-35f1b4f60425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fe216960db4a2ea3c150f98adede9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:22Z,use_quota=True,user_id='2900674461c64e13b86635b8c933eec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Creating volume 0378ce7e-f1bc-4f9a-acce-35f1b4f60425 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:34:22 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:22 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425 1073741824 Sep 29 16:34:22 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:22 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425 1073741824" returned: 0 in 0.557s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:22 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425 Sep 29 16:34:22 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:23 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425" returned: 0 in 0.328s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:34:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6790bfd3-662e-4737-ad4f-e9ab188435da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ef2ed9-b287-48b7-9809-6106e27eba73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:23 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Volume volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425 (0378ce7e-f1bc-4f9a-acce-35f1b4f60425): created successfully Sep 29 16:34:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ef2ed9-b287-48b7-9809-6106e27eba73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Flow 'volume_create_manager' (3e248621-b92c-4427-8bb0-fc3fa75d1565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:34:23 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-dd641d17-38fb-484c-8d2d-1a5f5beda11a tempest-AttachVolumeTestJSON-1343189258 None] Created volume successfully. Sep 29 16:34:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-49670ce6-f024-4c67-a292-83d3655280dc req-fc8c96f7-d285-471a-82c4-ecd145ba77d4 tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-49670ce6-f024-4c67-a292-83d3655280dc req-fc8c96f7-d285-471a-82c4-ecd145ba77d4 tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-49670ce6-f024-4c67-a292-83d3655280dc req-fc8c96f7-d285-471a-82c4-ecd145ba77d4 tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-49670ce6-f024-4c67-a292-83d3655280dc req-fc8c96f7-d285-471a-82c4-ecd145ba77d4 tempest-AttachVolumeTestJSON-1343189258 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec534381-2175-4239-8782-98be6d25e4ba', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:34:25 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-49670ce6-f024-4c67-a292-83d3655280dc req-fc8c96f7-d285-471a-82c4-ecd145ba77d4 tempest-AttachVolumeTestJSON-1343189258 None] attachment_update completed successfully. Sep 29 16:34:26 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:34:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Flow 'volume_create_manager' (94069306-98d0-4029-80b2-e20c5529e6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:34:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c3ef69-3448-4632-ab55-ec5163c031ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c3ef69-3448-4632-ab55-ec5163c031ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1488395878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16341ecd-31c3-4fc6-a364-2b06c77b9fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bfc82de8f2a4ff39a1d8128a907f484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:27Z,use_quota=True,user_id='5329602dde9e4ef88dcea237d085ff44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d81b8b0-2f57-4509-9e6c-46bdf90a0184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d81b8b0-2f57-4509-9e6c-46bdf90a0184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1a2161-3019-4ba8-bb4c-7651cd40bf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1a2161-3019-4ba8-bb4c-7651cd40bf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16341ecd-31c3-4fc6-a364-2b06c77b9fba', 'volume_name': 'volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17e2a71-62c2-4a3d-8846-6fafc2e00aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17e2a71-62c2-4a3d-8846-6fafc2e00aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2bcb03-e92c-44af-98b6-d4715b3e1bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:27 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Volume 16341ecd-31c3-4fc6-a364-2b06c77b9fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba', 'volume_size': 1} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1488395878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16341ecd-31c3-4fc6-a364-2b06c77b9fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bfc82de8f2a4ff39a1d8128a907f484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:27Z,use_quota=True,user_id='5329602dde9e4ef88dcea237d085ff44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Creating volume 16341ecd-31c3-4fc6-a364-2b06c77b9fba {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:34:27 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:27 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba 1073741824 Sep 29 16:34:27 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:27 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba 1073741824" returned: 0 in 0.557s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:27 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba Sep 29 16:34:27 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:28 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba" returned: 0 in 0.477s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:34:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2bcb03-e92c-44af-98b6-d4715b3e1bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9926e5-f3e7-46b5-8363-cec707fb71c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:28 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Volume volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba (16341ecd-31c3-4fc6-a364-2b06c77b9fba): created successfully Sep 29 16:34:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9926e5-f3e7-46b5-8363-cec707fb71c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Flow 'volume_create_manager' (94069306-98d0-4029-80b2-e20c5529e6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:34:28 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1bcf2e27-b8f9-41aa-9e7d-3ab6ac501c36 tempest-AttachVolumeShelveTestJSON-814105652 None] Created volume successfully. Sep 29 16:34:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:34:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:34:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:34:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:34 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:34:34 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:35 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.396s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:34:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:34:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 9 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:34:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Flow 'volume_create_manager' (9dd0f504-eb62-478a-9ce3-8652a73648c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1fdeb43-d61d-4d2e-8c9f-575913a97df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1fdeb43-d61d-4d2e-8c9f-575913a97df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-586789678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b46a65-6cc0-4c9d-a1a5-340e3698a81c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4397651e9a6e4d5ab453a618ecda2d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:36Z,use_quota=True,user_id='fa362a44915c44c3b1a63c16a060aeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c7f109-645e-4984-a037-5a287a5c8f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c7f109-645e-4984-a037-5a287a5c8f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ea1dac-6684-4826-a46f-9e6e405416d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ea1dac-6684-4826-a46f-9e6e405416d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b46a65-6cc0-4c9d-a1a5-340e3698a81c', 'volume_name': 'volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b338d71-7feb-4353-845e-a77fe0acf8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b338d71-7feb-4353-845e-a77fe0acf8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3218687f-6bfc-4f71-b7b9-2165816fbdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:36 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Volume 43b46a65-6cc0-4c9d-a1a5-340e3698a81c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c', 'volume_size': 1} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-586789678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b46a65-6cc0-4c9d-a1a5-340e3698a81c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4397651e9a6e4d5ab453a618ecda2d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:34:36Z,use_quota=True,user_id='fa362a44915c44c3b1a63c16a060aeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Creating volume 43b46a65-6cc0-4c9d-a1a5-340e3698a81c {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:34:36 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:34:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:36 devstack sudo[91882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c 1073741824 Sep 29 16:34:36 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:37 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c 1073741824" returned: 0 in 0.703s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:37 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c Sep 29 16:34:37 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:37 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c" returned: 0 in 0.286s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:34:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3218687f-6bfc-4f71-b7b9-2165816fbdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00827cfb-ab52-401a-a02a-49ad25037f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:34:37 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Volume volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c (43b46a65-6cc0-4c9d-a1a5-340e3698a81c): created successfully Sep 29 16:34:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00827cfb-ab52-401a-a02a-49ad25037f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:34:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Flow 'volume_create_manager' (9dd0f504-eb62-478a-9ce3-8652a73648c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:34:37 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-614c437f-0b26-4598-b047-15ba45a96777 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Created volume successfully. Sep 29 16:34:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Creating offline snapshot 7f3b3ce8-b734-4861-9689-8810a67b935e of volume 43b46a65-6cc0-4c9d-a1a5-340e3698a81c {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:34:38 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eecb017-68e5-4401-a56e-eaf239fe8f88]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:34:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:38 devstack sudo[91894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c Sep 29 16:34:38 devstack sudo[91894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:39 devstack sudo[91894]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c" returned: 0 in 0.504s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:39 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e 1G Sep 29 16:34:39 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:39 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e 1G" returned: 0 in 0.669s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:39 devstack sudo[91930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e Sep 29 16:34:39 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:40 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e" returned: 0 in 0.307s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:40 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e is being set with open permissions: ugo+rw Sep 29 16:34:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:40 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e Sep 29 16:34:40 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:40 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e" returned: 0 in 0.244s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:40 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.info Sep 29 16:34:40 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:40 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.info" returned: 0 in 0.293s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:40 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.info is being set with open permissions: ugo+rw Sep 29 16:34:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:40 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.info Sep 29 16:34:40 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:40 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.info" returned: 0 in 0.263s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:40 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fd1aa841-d0fb-4063-872a-cb9efd7b2584 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Create snapshot completed successfully Sep 29 16:34:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-d4dbc2c9-34c7-4577-a86c-fbaeb7f46ee6 req-731f78d1-9bfb-4e73-8ddf-0567f7b10faf tempest-AttachVolumeShelveTestJSON-814105652 None] No connector for attachment 2bc5b5d6-c22a-45e4-bc90-3d1fc12d1207; skipping storage backend terminate_connection call. {{(pid=86793) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 29 16:34:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-d4dbc2c9-34c7-4577-a86c-fbaeb7f46ee6 req-731f78d1-9bfb-4e73-8ddf-0567f7b10faf tempest-AttachVolumeShelveTestJSON-814105652 None] Deleting attachment 2bc5b5d6-c22a-45e4-bc90-3d1fc12d1207. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:34:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Acquiring lock "cinder-7f3b3ce8-b734-4861-9689-8810a67b935e-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:34:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "cinder-7f3b3ce8-b734-4861-9689-8810a67b935e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:34:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Acquiring lock "cinder-quobyte-43b46a65-6cc0-4c9d-a1a5-340e3698a81c" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:34:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "cinder-quobyte-43b46a65-6cc0-4c9d-a1a5-340e3698a81c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:34:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Acquiring lock "cinder-quobyte-7f3b3ce8-b734-4861-9689-8810a67b935e" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:34:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "cinder-quobyte-7f3b3ce8-b734-4861-9689-8810a67b935e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:34:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Deleting offline snapshot 7f3b3ce8-b734-4861-9689-8810a67b935e of volume 43b46a65-6cc0-4c9d-a1a5-340e3698a81c {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:34:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] snapshot_file for this snap is: volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:34:42 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a015f61-d27f-40ac-aa6d-1299728bb421]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:34:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:42 devstack sudo[91946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e Sep 29 16:34:42 devstack sudo[91946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:43 devstack sudo[91946]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e" returned: 0 in 0.464s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:34:43 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc735d1-d716-459c-9557-abe211e88669]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:34:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:43 devstack sudo[91953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c Sep 29 16:34:43 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:43 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c" returned: 0 in 0.491s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:43 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e Sep 29 16:34:43 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:44 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e" returned: 0 in 0.567s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:44 devstack sudo[91964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e Sep 29 16:34:44 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:44 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c.7f3b3ce8-b734-4861-9689-8810a67b935e" returned: 0 in 0.340s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "cinder-quobyte-7f3b3ce8-b734-4861-9689-8810a67b935e" released by "_delete_snapshot" :: held 2.050s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:34:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "cinder-quobyte-43b46a65-6cc0-4c9d-a1a5-340e3698a81c" released by "delete_snapshot" :: held 2.092s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:34:44 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Created reservations ['58a9c8d9-dc6a-436f-b031-08982da72c4f', '8b352893-1827-48bd-9f12-b6c5c42e3c9d', '9b956aff-1d06-4201-9d9d-541d331e3707', 'eb19ef28-f51e-45ea-b8d3-e839a7507bb1'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:34:44 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Delete snapshot completed successfully. Sep 29 16:34:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ce48185-7b8c-425a-ac77-35d4d0635ec6 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "cinder-7f3b3ce8-b734-4861-9689-8810a67b935e-delete_snapshot" released by "delete_snapshot" :: held 2.319s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:34:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Acquiring lock "cinder-43b46a65-6cc0-4c9d-a1a5-340e3698a81c-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:34:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "cinder-43b46a65-6cc0-4c9d-a1a5-340e3698a81c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:34:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Acquiring lock "cinder-quobyte-43b46a65-6cc0-4c9d-a1a5-340e3698a81c" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:34:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "cinder-quobyte-43b46a65-6cc0-4c9d-a1a5-340e3698a81c" acquired by "delete_volume" :: waited 0.031s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:34:45 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d87c5d-0669-4f4e-88cf-d9746af9f880]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:34:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-63d95c7f-4ce3-44ce-8a04-034f4b922c5e req-f9aa08df-a5f6-40fd-bc63-131252a172c6 tempest-ServerActionsTestOtherA-418642240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-63d95c7f-4ce3-44ce-8a04-034f4b922c5e req-f9aa08df-a5f6-40fd-bc63-131252a172c6 tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-63d95c7f-4ce3-44ce-8a04-034f4b922c5e req-f9aa08df-a5f6-40fd-bc63-131252a172c6 tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-63d95c7f-4ce3-44ce-8a04-034f4b922c5e req-f9aa08df-a5f6-40fd-bc63-131252a172c6 tempest-ServerActionsTestOtherA-418642240 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-37c7b475-6b06-42c0-bee6-a62f56dabd80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d2e0414-33b1-40a8-bf05-38d4945b4514', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:34:46 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c Sep 29 16:34:46 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:46 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-63d95c7f-4ce3-44ce-8a04-034f4b922c5e req-f9aa08df-a5f6-40fd-bc63-131252a172c6 tempest-ServerActionsTestOtherA-418642240 None] attachment_update completed successfully. Sep 29 16:34:46 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c" returned: 0 in 0.634s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:46 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c Sep 29 16:34:46 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:47 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43b46a65-6cc0-4c9d-a1a5-340e3698a81c" returned: 0 in 0.496s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "cinder-quobyte-43b46a65-6cc0-4c9d-a1a5-340e3698a81c" released by "delete_volume" :: held 1.232s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:34:47 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Created reservations ['959a4348-fdb7-499c-8297-771fcbd06662', '14e22414-6585-4baf-938f-27cd682b2443', 'c24f8093-7f34-409f-95ee-2511bc2d56a7', '568d7b67-1b96-4d1c-9060-37fcb5961872'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:34:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:34:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:34:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:34:47 devstack sudo[91998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:34:47 devstack sudo[91998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:34:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.374s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:34:47 devstack sudo[91998]: pam_unix(sudo:session): session closed for user root Sep 29 16:34:47 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:34:47 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Deleted volume successfully. Sep 29 16:34:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1482e161-131a-496d-be8b-3ec527850f83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1609397129 None] Lock "cinder-43b46a65-6cc0-4c9d-a1a5-340e3698a81c-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:34:50 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-04ba9dfb-9c12-43fd-a30c-8dde99b8aaee req-38b95e16-500a-4055-a375-ca9f28200ea5 tempest-ServerActionsTestOtherA-418642240 None] Terminate volume connection completed successfully. Sep 29 16:34:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-04ba9dfb-9c12-43fd-a30c-8dde99b8aaee req-38b95e16-500a-4055-a375-ca9f28200ea5 tempest-ServerActionsTestOtherA-418642240 None] Deleting attachment 4d2e0414-33b1-40a8-bf05-38d4945b4514. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:34:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-04ba9dfb-9c12-43fd-a30c-8dde99b8aaee req-e1538c06-b59b-4616-b351-97b991fdc58d tempest-ServerActionsTestOtherA-418642240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:34:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-04ba9dfb-9c12-43fd-a30c-8dde99b8aaee req-e1538c06-b59b-4616-b351-97b991fdc58d tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:34:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-04ba9dfb-9c12-43fd-a30c-8dde99b8aaee req-e1538c06-b59b-4616-b351-97b991fdc58d tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:34:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-04ba9dfb-9c12-43fd-a30c-8dde99b8aaee req-e1538c06-b59b-4616-b351-97b991fdc58d tempest-ServerActionsTestOtherA-418642240 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-37c7b475-6b06-42c0-bee6-a62f56dabd80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f60f06c-1e69-4ce7-8505-c6bd89e45837', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:34:52 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-04ba9dfb-9c12-43fd-a30c-8dde99b8aaee req-e1538c06-b59b-4616-b351-97b991fdc58d tempest-ServerActionsTestOtherA-418642240 None] attachment_update completed successfully. Sep 29 16:34:59 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-293dd9bf-facd-49eb-83e2-93fd07173e3a req-869d0313-8c27-4460-874e-dd761fa6a959 tempest-AttachVolumeTestJSON-1343189258 None] Terminate volume connection completed successfully. Sep 29 16:34:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-293dd9bf-facd-49eb-83e2-93fd07173e3a req-869d0313-8c27-4460-874e-dd761fa6a959 tempest-AttachVolumeTestJSON-1343189258 None] Deleting attachment ec534381-2175-4239-8782-98be6d25e4ba. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:35:02 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=57,cinder:UPDATE=48,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Flow 'volume_create_manager' (1dc84631-3f25-4d90-a87e-a94c6a52a2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df5901d-7ad0-44ae-bcd3-77da6359b77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df5901d-7ad0-44ae-bcd3-77da6359b77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1631977877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c60e73-2d83-4d38-8a9b-ebc912f84d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b9468486c64dfb9cb0a39e353f1a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:07Z,use_quota=True,user_id='65537e12276943a8aa6a371bfe4e2e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f922f5-4957-4d17-8807-cfcb301c76bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f922f5-4957-4d17-8807-cfcb301c76bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318b58b6-36e6-458b-b202-a15f2c831438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318b58b6-36e6-458b-b202-a15f2c831438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c60e73-2d83-4d38-8a9b-ebc912f84d3b', 'volume_name': 'volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ee96bd-0dac-48d6-83cb-f0d8be5b82fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ee96bd-0dac-48d6-83cb-f0d8be5b82fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3179b01-7e68-418a-bd78-1f60a542d747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:06 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Volume 34c60e73-2d83-4d38-8a9b-ebc912f84d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b', 'volume_size': 1} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1631977877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c60e73-2d83-4d38-8a9b-ebc912f84d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b9468486c64dfb9cb0a39e353f1a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:07Z,use_quota=True,user_id='65537e12276943a8aa6a371bfe4e2e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Creating volume 34c60e73-2d83-4d38-8a9b-ebc912f84d3b {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:35:06 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:35:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:06 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b 1073741824 Sep 29 16:35:06 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:07 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b 1073741824" returned: 0 in 0.993s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:07 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=63,cinder:UPDATE=47,cinder:INSERT=12,cinder:DELETE=5 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:35:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:08 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b Sep 29 16:35:08 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:08 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b" returned: 0 in 0.464s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:35:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3179b01-7e68-418a-bd78-1f60a542d747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7016d7a4-28f4-4cb9-9f13-17685f40547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:08 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Volume volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b (34c60e73-2d83-4d38-8a9b-ebc912f84d3b): created successfully Sep 29 16:35:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7016d7a4-28f4-4cb9-9f13-17685f40547b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Flow 'volume_create_manager' (1dc84631-3f25-4d90-a87e-a94c6a52a2aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:08 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-10af5d64-e97d-46f0-9a5c-89ef27aafa80 tempest-SnapshotMetadataTestJSON-1598377682 None] Created volume successfully. Sep 29 16:35:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] Creating offline snapshot 882f4781-efc7-4667-841b-47392c468c1b of volume 34c60e73-2d83-4d38-8a9b-ebc912f84d3b {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:35:10 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[92db8ae2-4ea0-4648-a1df-e2e120b86daf]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:10 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b Sep 29 16:35:10 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:10 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b" returned: 0 in 0.407s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:10 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b 1G Sep 29 16:35:10 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:11 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b 1G" returned: 0 in 0.533s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:11 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b Sep 29 16:35:11 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:11 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b" returned: 0 in 0.367s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:11 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b is being set with open permissions: ugo+rw Sep 29 16:35:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:11 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b Sep 29 16:35:11 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:11 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b" returned: 0 in 0.282s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:11 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.info Sep 29 16:35:11 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:12 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.info" returned: 0 in 0.296s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:12 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.info is being set with open permissions: ugo+rw Sep 29 16:35:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:12 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.info Sep 29 16:35:12 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:12 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.info" returned: 0 in 0.282s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.292s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:12 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-96ae7a97-1da1-47b7-a5dd-efd659ff4faf tempest-SnapshotMetadataTestJSON-1598377682 None] Create snapshot completed successfully Sep 29 16:35:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Acquiring lock "cinder-882f4781-efc7-4667-841b-47392c468c1b-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "cinder-882f4781-efc7-4667-841b-47392c468c1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Acquiring lock "cinder-quobyte-34c60e73-2d83-4d38-8a9b-ebc912f84d3b" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "cinder-quobyte-34c60e73-2d83-4d38-8a9b-ebc912f84d3b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Acquiring lock "cinder-quobyte-882f4781-efc7-4667-841b-47392c468c1b" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "cinder-quobyte-882f4781-efc7-4667-841b-47392c468c1b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Deleting offline snapshot 882f4781-efc7-4667-841b-47392c468c1b of volume 34c60e73-2d83-4d38-8a9b-ebc912f84d3b {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:35:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] snapshot_file for this snap is: volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:35:14 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f00451-fd5a-48b8-9e10-48ad1a9e76be]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:14 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b Sep 29 16:35:14 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:14 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b" returned: 0 in 0.415s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:35:14 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce637dac-906a-4d12-9ee3-07af63951bed]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:14 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b Sep 29 16:35:14 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:15 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b" returned: 0 in 0.412s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:15 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b Sep 29 16:35:15 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:15 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b" returned: 0 in 0.529s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:15 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b Sep 29 16:35:15 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:15 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b.882f4781-efc7-4667-841b-47392c468c1b" returned: 0 in 0.270s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "cinder-quobyte-882f4781-efc7-4667-841b-47392c468c1b" released by "_delete_snapshot" :: held 1.775s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "cinder-quobyte-34c60e73-2d83-4d38-8a9b-ebc912f84d3b" released by "delete_snapshot" :: held 1.806s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:16 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Created reservations ['78cce4a2-e543-4846-ba5f-90505829f445', 'db2a431d-61eb-4da9-ba6c-e04aef56cb6e', 'c6b66c60-8bd3-4c67-98fa-8e11031a3d28', '060f0725-64f0-45cb-b143-2542a1a0a6da'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:35:16 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Delete snapshot completed successfully. Sep 29 16:35:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-14be2f3f-d7df-49ee-b0ff-2e1c32ae2d45 tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "cinder-882f4781-efc7-4667-841b-47392c468c1b-delete_snapshot" released by "delete_snapshot" :: held 1.961s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Acquiring lock "cinder-34c60e73-2d83-4d38-8a9b-ebc912f84d3b-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "cinder-34c60e73-2d83-4d38-8a9b-ebc912f84d3b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Acquiring lock "cinder-quobyte-34c60e73-2d83-4d38-8a9b-ebc912f84d3b" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "cinder-quobyte-34c60e73-2d83-4d38-8a9b-ebc912f84d3b" acquired by "delete_volume" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:16 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4394681e-ec76-4834-8ef6-99038a73bf9b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:16 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b Sep 29 16:35:16 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:16 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b" returned: 0 in 0.446s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:17 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b Sep 29 16:35:17 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:17 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-34c60e73-2d83-4d38-8a9b-ebc912f84d3b" returned: 0 in 0.307s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "cinder-quobyte-34c60e73-2d83-4d38-8a9b-ebc912f84d3b" released by "delete_volume" :: held 0.832s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:17 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Created reservations ['cdcc6f02-701a-40c5-9f32-4057f9da9e64', '08aa78f4-5db1-4879-8f55-65695cca2fb3', 'd41acbb5-a6d5-4ce4-8acd-fdafedfce54d', '94f59f7b-d896-4080-8ebd-b92254b520eb'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:35:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:17 devstack sudo[92585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:35:17 devstack sudo[92585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:17 devstack sudo[92585]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.270s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:17 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:35:17 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Deleted volume successfully. Sep 29 16:35:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-311cc309-c061-451c-a55a-31b33fb9301b tempest-SnapshotMetadataTestJSON-1598377682 None] Lock "cinder-34c60e73-2d83-4d38-8a9b-ebc912f84d3b-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Flow 'volume_create_manager' (735d6cf3-9f39-4bba-9a4f-00eda8171d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171ba470-271c-4278-8c4e-c46bf9282548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171ba470-271c-4278-8c4e-c46bf9282548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-164638163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec53abdb-2eff-4873-bbc7-efa167cf8f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b89ecfc0080416691a225640ca4b9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:22Z,use_quota=True,user_id='714068eece2e425298c2fea5657d99ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20feb249-b265-4bd9-a3fa-cdc7c0e035ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20feb249-b265-4bd9-a3fa-cdc7c0e035ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3ecc04-0bf7-4cc3-b827-de91f385a34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3ecc04-0bf7-4cc3-b827-de91f385a34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec53abdb-2eff-4873-bbc7-efa167cf8f18', 'volume_name': 'volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad67f8c2-7bdf-4089-92ed-47ceb5819916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad67f8c2-7bdf-4089-92ed-47ceb5819916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c4e189-2388-490c-800c-90ba5399cb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:21 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Volume ec53abdb-2eff-4873-bbc7-efa167cf8f18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18', 'volume_size': 1} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-164638163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec53abdb-2eff-4873-bbc7-efa167cf8f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b89ecfc0080416691a225640ca4b9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:22Z,use_quota=True,user_id='714068eece2e425298c2fea5657d99ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Creating volume ec53abdb-2eff-4873-bbc7-efa167cf8f18 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:35:21 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:35:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:21 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 1073741824 Sep 29 16:35:21 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:22 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 1073741824" returned: 0 in 0.651s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:22 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 Sep 29 16:35:22 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:23 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18" returned: 0 in 0.490s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:35:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c4e189-2388-490c-800c-90ba5399cb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574e893b-9597-460d-8ec1-695c3aef2cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:23 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Volume volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 (ec53abdb-2eff-4873-bbc7-efa167cf8f18): created successfully Sep 29 16:35:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (574e893b-9597-460d-8ec1-695c3aef2cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Flow 'volume_create_manager' (735d6cf3-9f39-4bba-9a4f-00eda8171d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:23 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ab734fb5-1f7e-4301-b33c-8bd99bc758ef tempest-VolumesDeleteCascade-2075360688 None] Created volume successfully. Sep 29 16:35:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] Creating offline snapshot f768b739-3588-442f-9c60-34acf9ced243 of volume ec53abdb-2eff-4873-bbc7-efa167cf8f18 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:35:24 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e40e5a0-4c4e-4ba9-beaf-ec5277eff6db]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:24 devstack sudo[92639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 Sep 29 16:35:24 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:24 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18" returned: 0 in 0.433s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:24 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 1G Sep 29 16:35:24 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:25 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 1G" returned: 0 in 0.506s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:25 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 Sep 29 16:35:25 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:25 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243" returned: 0 in 0.305s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:25 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 is being set with open permissions: ugo+rw Sep 29 16:35:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:25 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 Sep 29 16:35:25 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:26 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243" returned: 0 in 0.250s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:26 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.info Sep 29 16:35:26 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:26 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.info" returned: 0 in 0.258s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:26 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.info is being set with open permissions: ugo+rw Sep 29 16:35:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:26 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.info Sep 29 16:35:26 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:26 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.info" returned: 0 in 0.279s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:26 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-badd07ea-f0ca-43be-9e13-af1ea3637e34 tempest-VolumesDeleteCascade-2075360688 None] Create snapshot completed successfully Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Acquiring lock "cinder-16341ecd-31c3-4fc6-a364-2b06c77b9fba-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Lock "cinder-16341ecd-31c3-4fc6-a364-2b06c77b9fba-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Acquiring lock "cinder-quobyte-16341ecd-31c3-4fc6-a364-2b06c77b9fba" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Lock "cinder-quobyte-16341ecd-31c3-4fc6-a364-2b06c77b9fba" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[084dd567-a677-4fa6-8dfe-f18c59dd6fc4]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:27 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba Sep 29 16:35:27 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:27 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba" returned: 0 in 0.366s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:27 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba Sep 29 16:35:27 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] Creating offline snapshot c870d49a-ffc6-4755-b092-b38269f2dc67 of volume ec53abdb-2eff-4873-bbc7-efa167cf8f18 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b424541b-931f-424f-a6f7-7b2f81ff7433]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:27 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-16341ecd-31c3-4fc6-a364-2b06c77b9fba" returned: 0 in 0.290s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Lock "cinder-quobyte-16341ecd-31c3-4fc6-a364-2b06c77b9fba" released by "delete_volume" :: held 0.700s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:27 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 Sep 29 16:35:27 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:27 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Created reservations ['bfa0b169-5d64-401c-b5e7-10d92abc3b9b', '8b505b0c-ce42-4aa0-b3e1-e9f8f6dc05c3', 'dd8b13d0-0168-4e24-bd68-4e3c326f2725', '16935093-71fa-4d99-8bd6-09aaeaf87122'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:28 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:35:28 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:28 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243" returned: 0 in 0.378s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:28 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 1G Sep 29 16:35:28 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:28 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.262s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:35:28 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Deleted volume successfully. Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-761b0149-3aed-4977-b700-03c0a4e64132 tempest-AttachVolumeShelveTestJSON-814105652 None] Lock "cinder-16341ecd-31c3-4fc6-a364-2b06c77b9fba-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:28 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 1G" returned: 0 in 0.493s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:28 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 Sep 29 16:35:28 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:28 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67" returned: 0 in 0.284s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:28 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 is being set with open permissions: ugo+rw Sep 29 16:35:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:28 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 Sep 29 16:35:28 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:29 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67" returned: 0 in 0.297s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.559s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:29 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-d7a6ef35-d6cd-4a48-a0a8-b9dfef39f2ca tempest-VolumesDeleteCascade-2075360688 None] Create snapshot completed successfully Sep 29 16:35:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-ec53abdb-2eff-4873-bbc7-efa167cf8f18-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-ec53abdb-2eff-4873-bbc7-efa167cf8f18-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Performing cascade delete. {{(pid=86793) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 29 16:35:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-c870d49a-ffc6-4755-b092-b38269f2dc67-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-c870d49a-ffc6-4755-b092-b38269f2dc67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-quobyte-ec53abdb-2eff-4873-bbc7-efa167cf8f18" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-ec53abdb-2eff-4873-bbc7-efa167cf8f18" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-quobyte-c870d49a-ffc6-4755-b092-b38269f2dc67" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-c870d49a-ffc6-4755-b092-b38269f2dc67" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Deleting offline snapshot c870d49a-ffc6-4755-b092-b38269f2dc67 of volume ec53abdb-2eff-4873-bbc7-efa167cf8f18 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] snapshot_file for this snap is: volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[48013269-7d9f-485f-9097-2b2c72ce9ac9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:30 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 Sep 29 16:35:30 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:30 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67" returned: 0 in 0.378s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfda45b2-46fe-4d96-b7b4-94dd01d643fd]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:30 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 Sep 29 16:35:30 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:30 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243" returned: 0 in 0.397s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:35:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:30 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 Sep 29 16:35:30 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:31 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67" returned: 0 in 0.419s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:31 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67 Sep 29 16:35:31 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:31 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.c870d49a-ffc6-4755-b092-b38269f2dc67" returned: 0 in 0.255s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-c870d49a-ffc6-4755-b092-b38269f2dc67" released by "_delete_snapshot" :: held 1.568s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-ec53abdb-2eff-4873-bbc7-efa167cf8f18" released by "delete_snapshot" :: held 1.594s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Created reservations ['7d11c822-deac-408f-b349-e2f66658015d', '2f7c7bd2-9f20-48fd-80fc-3a18e05eb96d', 'e81ee627-c65b-41eb-b7df-7b97c83c624a', '387fc00e-a861-468e-9311-7c9b9cc9194f'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:35:31 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Delete snapshot completed successfully. Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-c870d49a-ffc6-4755-b092-b38269f2dc67-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-f768b739-3588-442f-9c60-34acf9ced243-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-f768b739-3588-442f-9c60-34acf9ced243-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-quobyte-ec53abdb-2eff-4873-bbc7-efa167cf8f18" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-ec53abdb-2eff-4873-bbc7-efa167cf8f18" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-quobyte-f768b739-3588-442f-9c60-34acf9ced243" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-f768b739-3588-442f-9c60-34acf9ced243" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Deleting offline snapshot f768b739-3588-442f-9c60-34acf9ced243 of volume ec53abdb-2eff-4873-bbc7-efa167cf8f18 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:35:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] snapshot_file for this snap is: volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:35:32 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1422113-10ea-4876-b2df-a8273b1df29c]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:32 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 Sep 29 16:35:32 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:32 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243" returned: 0 in 0.395s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:35:32 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[90954929-3711-4284-8bae-69103c3ba171]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:32 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 Sep 29 16:35:32 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:32 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18" returned: 0 in 0.404s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:32 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 Sep 29 16:35:32 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:33 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243" returned: 0 in 0.358s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:33 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243 Sep 29 16:35:33 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:33 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18.f768b739-3588-442f-9c60-34acf9ced243" returned: 0 in 0.255s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-f768b739-3588-442f-9c60-34acf9ced243" released by "_delete_snapshot" :: held 1.570s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-ec53abdb-2eff-4873-bbc7-efa167cf8f18" released by "delete_snapshot" :: held 1.614s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:33 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Created reservations ['9f4f54f2-b580-406f-b8ec-584f1b4d2a81', '09847bcd-34ba-4013-a62f-ee2687b8c514', '6fa5f863-56b5-40a1-8ab6-c2aae356eafa', '16e291c2-f312-4138-acf7-3929d569995a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:35:33 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Delete snapshot completed successfully. Sep 29 16:35:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-f768b739-3588-442f-9c60-34acf9ced243-delete_snapshot" released by "delete_snapshot" :: held 1.812s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Snapshots deleted, issuing volume delete {{(pid=86793) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 29 16:35:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-quobyte-ec53abdb-2eff-4873-bbc7-efa167cf8f18" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-ec53abdb-2eff-4873-bbc7-efa167cf8f18" acquired by "delete_volume" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:33 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[087bc4d3-324f-46c3-a986-e972426d0831]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:33 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 Sep 29 16:35:33 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:34 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18" returned: 0 in 0.372s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:34 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18 Sep 29 16:35:34 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:34 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec53abdb-2eff-4873-bbc7-efa167cf8f18" returned: 0 in 0.263s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-ec53abdb-2eff-4873-bbc7-efa167cf8f18" released by "delete_volume" :: held 0.718s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Created reservations ['1a38f3fa-baaf-4fe7-87d4-772554823342', '5f057133-d7a1-4051-aa04-7c716f872784', 'f3ba9e1a-e4fe-4ea0-b58c-9a735d1617a1', '33ae6ebb-12ce-4bba-8134-c27d9be12ae6'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:34 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:35:34 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:34 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.248s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:34 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Deleted volume successfully. Sep 29 16:35:34 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:35:34 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9ba72ce5-38c9-4612-bd55-f467f22a99d1 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-ec53abdb-2eff-4873-bbc7-efa167cf8f18-delete_volume" released by "delete_volume" :: held 4.918s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:35 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.261s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:35:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:35:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 9 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:35:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Flow 'volume_create_manager' (7261d918-0732-488a-b21c-759ca02edc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd38806-d869-49c6-ad24-b25f1a0e4b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd38806-d869-49c6-ad24-b25f1a0e4b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-151016030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f68acc-c08b-46f0-9113-392fb62046cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01d9626d3960458c9558aaeae13a7614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:36Z,use_quota=True,user_id='f53bbbf53ad54f1ca621f831137f916f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd15f4b-75fd-4b74-9be8-da3b5ba8566d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfd15f4b-75fd-4b74-9be8-da3b5ba8566d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcad63d-58ba-43b8-aa9a-7e211af0b0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcad63d-58ba-43b8-aa9a-7e211af0b0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81f68acc-c08b-46f0-9113-392fb62046cf', 'volume_name': 'volume-81f68acc-c08b-46f0-9113-392fb62046cf', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2789e38-25b8-4020-ab0f-271a8f1a5ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2789e38-25b8-4020-ab0f-271a8f1a5ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3d677f-2288-41da-b200-cadb817f23db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:36 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Volume 81f68acc-c08b-46f0-9113-392fb62046cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81f68acc-c08b-46f0-9113-392fb62046cf', 'volume_size': 1} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-151016030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f68acc-c08b-46f0-9113-392fb62046cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='01d9626d3960458c9558aaeae13a7614',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:36Z,use_quota=True,user_id='f53bbbf53ad54f1ca621f831137f916f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Creating volume 81f68acc-c08b-46f0-9113-392fb62046cf {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:35:36 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-81f68acc-c08b-46f0-9113-392fb62046cf 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:36 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-81f68acc-c08b-46f0-9113-392fb62046cf 1073741824 Sep 29 16:35:36 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Flow 'volume_create_manager' (2a7fff34-ada6-4892-84de-fd88abf7dcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553252d6-2721-490a-ae8b-9a128d93f867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553252d6-2721-490a-ae8b-9a128d93f867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1646262258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bc15b8-b440-43af-9880-f91f16687271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b89ecfc0080416691a225640ca4b9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:36Z,use_quota=True,user_id='714068eece2e425298c2fea5657d99ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928e88bd-ba27-4f21-a41d-05828dc36dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928e88bd-ba27-4f21-a41d-05828dc36dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034547b2-4f5e-4ed9-9c32-d9571c980682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034547b2-4f5e-4ed9-9c32-d9571c980682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10bc15b8-b440-43af-9880-f91f16687271', 'volume_name': 'volume-10bc15b8-b440-43af-9880-f91f16687271', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d29237-7838-479f-8b34-cef7dc7f64eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d29237-7838-479f-8b34-cef7dc7f64eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d166d1df-018b-4e57-8719-785750f619ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:36 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Volume 10bc15b8-b440-43af-9880-f91f16687271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10bc15b8-b440-43af-9880-f91f16687271', 'volume_size': 1} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:36 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-81f68acc-c08b-46f0-9113-392fb62046cf 1073741824" returned: 0 in 0.424s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-81f68acc-c08b-46f0-9113-392fb62046cf {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:36 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-81f68acc-c08b-46f0-9113-392fb62046cf Sep 29 16:35:36 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:36 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-81f68acc-c08b-46f0-9113-392fb62046cf" returned: 0 in 0.233s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.534s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1646262258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bc15b8-b440-43af-9880-f91f16687271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b89ecfc0080416691a225640ca4b9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:36Z,use_quota=True,user_id='714068eece2e425298c2fea5657d99ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Creating volume 10bc15b8-b440-43af-9880-f91f16687271 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:35:36 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:35:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3d677f-2288-41da-b200-cadb817f23db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81f68acc-c08b-46f0-9113-392fb62046cf', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:37 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 1073741824 Sep 29 16:35:37 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b60974-4dea-4ff9-abb9-642ad21e6fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:37 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Volume volume-81f68acc-c08b-46f0-9113-392fb62046cf (81f68acc-c08b-46f0-9113-392fb62046cf): created successfully Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b60974-4dea-4ff9-abb9-642ad21e6fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Flow 'volume_create_manager' (7261d918-0732-488a-b21c-759ca02edc73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:37 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-943da49b-44d2-427f-a29a-93ca00e9be09 req-c1cc4535-b240-4706-8289-de41a4d28160 tempest-VolumesGetTestJSON-976961695 None] Created volume successfully. Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Acquiring lock "cinder-81f68acc-c08b-46f0-9113-392fb62046cf-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Lock "cinder-81f68acc-c08b-46f0-9113-392fb62046cf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Acquiring lock "cinder-quobyte-81f68acc-c08b-46f0-9113-392fb62046cf" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Lock "cinder-quobyte-81f68acc-c08b-46f0-9113-392fb62046cf" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebb6663-55e0-4bfb-9056-26a37076a51d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-81f68acc-c08b-46f0-9113-392fb62046cf {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:37 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 1073741824" returned: 0 in 0.545s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:37 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 Sep 29 16:35:37 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:37 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-81f68acc-c08b-46f0-9113-392fb62046cf Sep 29 16:35:37 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:37 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271" returned: 0 in 0.309s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d166d1df-018b-4e57-8719-785750f619ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10bc15b8-b440-43af-9880-f91f16687271', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4465f036-c00e-4015-8bf6-2f41ff353401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:37 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Volume volume-10bc15b8-b440-43af-9880-f91f16687271 (10bc15b8-b440-43af-9880-f91f16687271): created successfully Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4465f036-c00e-4015-8bf6-2f41ff353401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Flow 'volume_create_manager' (2a7fff34-ada6-4892-84de-fd88abf7dcac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:37 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-8646e08f-1904-412b-88a2-f1e341eb70ff tempest-VolumesDeleteCascade-2075360688 None] Created volume successfully. Sep 29 16:35:37 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-81f68acc-c08b-46f0-9113-392fb62046cf" returned: 0 in 0.445s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-81f68acc-c08b-46f0-9113-392fb62046cf {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:37 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-81f68acc-c08b-46f0-9113-392fb62046cf Sep 29 16:35:37 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:38 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-81f68acc-c08b-46f0-9113-392fb62046cf" returned: 0 in 0.264s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Lock "cinder-quobyte-81f68acc-c08b-46f0-9113-392fb62046cf" released by "delete_volume" :: held 0.759s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG cinder.quota [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Created reservations ['97f02417-52c9-426c-97aa-5e4bfa5a7f76', '5cd4ed6a-c21d-4401-8136-0ac996894383', 'b804dd5e-a50e-4c61-b836-c4786f4db2f6', '9198da60-d07e-4956-8acb-cc3f0d596aad'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:38 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:35:38 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:38 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-6cdde51b-6f46-4f26-91ab-6cc87f842534 req-ca777fd3-008d-4350-97da-0ddd7e82afa2 tempest-ServerActionsTestOtherA-418642240 None] Terminate volume connection completed successfully. Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-6cdde51b-6f46-4f26-91ab-6cc87f842534 req-ca777fd3-008d-4350-97da-0ddd7e82afa2 tempest-ServerActionsTestOtherA-418642240 None] Deleting attachment 5f60f06c-1e69-4ce7-8505-c6bd89e45837. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] Creating offline snapshot 4987a7d3-6e8c-4ccd-904f-5ac5798a3201 of volume 10bc15b8-b440-43af-9880-f91f16687271 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4df189d-af6c-489f-a52f-0ab0f519bb87]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:38 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.391s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG cinder.manager [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:35:38 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Deleted volume successfully. Sep 29 16:35:38 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-df85a9ad-98ed-41c4-832a-fbff9351080b req-44009976-6df8-4c30-a982-7daa049d97d5 tempest-VolumesGetTestJSON-976961695 None] Lock "cinder-81f68acc-c08b-46f0-9113-392fb62046cf-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:38 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 Sep 29 16:35:38 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:39 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271" returned: 0 in 0.461s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:39 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 1G Sep 29 16:35:39 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:39 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 1G" returned: 0 in 0.553s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bc15b8-b440-43af-9880-f91f16687271 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:39 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bc15b8-b440-43af-9880-f91f16687271 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 Sep 29 16:35:39 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:40 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bc15b8-b440-43af-9880-f91f16687271 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201" returned: 0 in 0.527s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:40 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 is being set with open permissions: ugo+rw Sep 29 16:35:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:40 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 Sep 29 16:35:40 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:40 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201" returned: 0 in 0.305s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:40 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.info Sep 29 16:35:40 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:40 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.info" returned: 0 in 0.314s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:40 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.info is being set with open permissions: ugo+rw Sep 29 16:35:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:40 devstack sudo[92844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.info Sep 29 16:35:40 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:41 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.info" returned: 0 in 0.335s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.652s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:41 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-96f653d4-29eb-4836-9a09-5d884e604e99 tempest-VolumesDeleteCascade-2075360688 None] Create snapshot completed successfully Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Flow 'volume_create_manager' (03ba6fed-ff6d-4dfb-993b-512fa1fcaec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b3ba1e-f931-447f-9441-507fc8881714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b3ba1e-f931-447f-9441-507fc8881714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-935501547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2caa209a-3347-41ed-882b-80af03df12e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b89ecfc0080416691a225640ca4b9d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4987a7d3-6e8c-4ccd-904f-5ac5798a3201,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:42Z,use_quota=True,user_id='714068eece2e425298c2fea5657d99ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fbcfa7-3458-4018-9ffe-0694bf2e6fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fbcfa7-3458-4018-9ffe-0694bf2e6fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4d8380-738e-4c51-bd52-b91a2d7d9a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4d8380-738e-4c51-bd52-b91a2d7d9a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2caa209a-3347-41ed-882b-80af03df12e9', 'volume_name': 'volume-2caa209a-3347-41ed-882b-80af03df12e9', 'volume_size': 1, 'snapshot_id': '4987a7d3-6e8c-4ccd-904f-5ac5798a3201'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2dad47a-ccac-42e7-958e-e330b465d1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2dad47a-ccac-42e7-958e-e330b465d1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6c557f-29ca-4804-bac0-626196b89762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:42 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Volume 2caa209a-3347-41ed-882b-80af03df12e9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2caa209a-3347-41ed-882b-80af03df12e9', 'volume_size': 1, 'snapshot_id': '4987a7d3-6e8c-4ccd-904f-5ac5798a3201'} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-quobyte-4987a7d3-6e8c-4ccd-904f-5ac5798a3201-2caa209a-3347-41ed-882b-80af03df12e9" by "_create_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-4987a7d3-6e8c-4ccd-904f-5ac5798a3201-2caa209a-3347-41ed-882b-80af03df12e9" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Creating volume 2caa209a-3347-41ed-882b-80af03df12e9 from snapshot 4987a7d3-6e8c-4ccd-904f-5ac5798a3201 {{(pid=86793) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-quobyte-2caa209a-3347-41ed-882b-80af03df12e9" by "_copy_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-2caa209a-3347-41ed-882b-80af03df12e9" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] snapshot: 4987a7d3-6e8c-4ccd-904f-5ac5798a3201, volume: 2caa209a-3347-41ed-882b-80af03df12e9, {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6818656-1591-4d8c-a1aa-2cebfdfbea59]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:42 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 Sep 29 16:35:42 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:43 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201" returned: 0 in 0.454s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10bc15b8-b440-43af-9880-f91f16687271(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:35:43 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59b4dee-c54e-4649-b066-6926932f22fa]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:43 devstack sudo[92856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 Sep 29 16:35:43 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:43 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271" returned: 0 in 0.399s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] will copy from snapshot at /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 16:35:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Creating direct copy from snapshot {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 16:35:43 devstack cinder-volume[86793]: DEBUG cinder.utils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Path /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9 not found in is_blk_device check {{(pid=86793) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 16:35:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:43 devstack sudo[92861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9 Sep 29 16:35:43 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:44 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:35:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Flow 'volume_create_manager' (fa862e8c-12ea-43b7-89cf-815a0bab7040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5873c6b-2db4-4805-8a68-b791af5574ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5873c6b-2db4-4805-8a68-b791af5574ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-993904279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73673e02-2fe1-49df-b535-4d9d4104534d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b7e46cd8f5048bc86ce00bb0c651708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:44Z,use_quota=True,user_id='f102857dddef49eeb43880c1cfde23f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e2760b-cd56-4d21-bb57-6f60c075db2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e2760b-cd56-4d21-bb57-6f60c075db2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47a6672-5e95-4015-b0ed-d6193ef08564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47a6672-5e95-4015-b0ed-d6193ef08564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73673e02-2fe1-49df-b535-4d9d4104534d', 'volume_name': 'volume-73673e02-2fe1-49df-b535-4d9d4104534d', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6ee9d1-6da4-4c3c-abcf-073945ceb512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c6ee9d1-6da4-4c3c-abcf-073945ceb512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed03a68-0e09-406f-9f0c-477cf618f67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:44 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Volume 73673e02-2fe1-49df-b535-4d9d4104534d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73673e02-2fe1-49df-b535-4d9d4104534d', 'volume_size': 1} Sep 29 16:35:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:45 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:35:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Flow 'volume_create_manager' (776571d5-59ae-41c4-8bbd-262c522d6ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047490ae-31f6-4db7-89d3-2e989100a0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (047490ae-31f6-4db7-89d3-2e989100a0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1614037703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04403e55-f239-4a48-900b-35c297d83129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f4a435e0b447e9eadac24855891f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:46Z,use_quota=True,user_id='23b55561146e44f1ae42189b2fcc0cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b5759f-df6c-478a-b81f-5ca7f9f6b6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b5759f-df6c-478a-b81f-5ca7f9f6b6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02beaa3-1776-4d0a-9adf-4609fe75c095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:45 devstack cinder-volume[86793]: DEBUG cinder.image.glance [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Creating Keystone auth plugin from conf {{(pid=86793) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 16:35:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02beaa3-1776-4d0a-9adf-4609fe75c095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '04403e55-f239-4a48-900b-35c297d83129', 'volume_name': 'volume-04403e55-f239-4a48-900b-35c297d83129', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6529e38-1cc9-4a0e-b153-96933ca2ca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6529e38-1cc9-4a0e-b153-96933ca2ca5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcc0e9b-8800-48ef-b1c0-7715a8c20a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:46 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Volume 04403e55-f239-4a48-900b-35c297d83129: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-04403e55-f239-4a48-900b-35c297d83129', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 16:35:46 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Trying to clone 04403e55-f239-4a48-900b-35c297d83129 from image 041fad70-7851-4f49-af92-c1fc35c4c3b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]). {{(pid=86793) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 16:35:47 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_k53pc_xgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 16:35:47 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Image download 20.69 MB at 20.69 MB/s Sep 29 16:35:47 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60d4a1a-6737-41f0-a3a5-c629210ff959]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_k53pc_xgdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:48 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_k53pc_xgdevstack@QuobyteHD Sep 29 16:35:48 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:48 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_k53pc_xgdevstack@QuobyteHD" returned: 0 in 0.774s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:48 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Temporary image 041fad70-7851-4f49-af92-c1fc35c4c3b2 is fetched for user 23b55561146e44f1ae42189b2fcc0cea. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 16:35:48 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[98540b9b-7183-4ea0-a2ac-75c4c9141198]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_k53pc_xgdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:49 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_k53pc_xgdevstack@QuobyteHD Sep 29 16:35:49 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:49 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_k53pc_xgdevstack@QuobyteHD" returned: 0 in 0.652s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:52 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9" returned: 0 in 8.444s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271, size 1024.00 MB, duration 8.44 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:35:52 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Converted 1024.00 MB image at 121.26 MB/s Sep 29 16:35:52 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9 is being set with open permissions: ugo+rw Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:52 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9 Sep 29 16:35:52 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:52 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9" returned: 0 in 0.243s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-2caa209a-3347-41ed-882b-80af03df12e9" released by "_copy_volume_from_snapshot" :: held 9.650s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-4987a7d3-6e8c-4ccd-904f-5ac5798a3201-2caa209a-3347-41ed-882b-80af03df12e9" released by "_create_volume_from_snapshot" :: held 9.717s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.739s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.163s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-993904279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73673e02-2fe1-49df-b535-4d9d4104534d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b7e46cd8f5048bc86ce00bb0c651708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:44Z,use_quota=True,user_id='f102857dddef49eeb43880c1cfde23f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Creating volume 73673e02-2fe1-49df-b535-4d9d4104534d {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:35:52 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-73673e02-2fe1-49df-b535-4d9d4104534d 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:52 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-73673e02-2fe1-49df-b535-4d9d4104534d 1073741824 Sep 29 16:35:52 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6c557f-29ca-4804-bac0-626196b89762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2caa209a-3347-41ed-882b-80af03df12e9', 'volume_size': 1, 'snapshot_id': '4987a7d3-6e8c-4ccd-904f-5ac5798a3201'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24745f23-0ad0-4e82-998e-b0a20fb18b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:52 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Volume volume-2caa209a-3347-41ed-882b-80af03df12e9 (2caa209a-3347-41ed-882b-80af03df12e9): created successfully Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24745f23-0ad0-4e82-998e-b0a20fb18b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Flow 'volume_create_manager' (03ba6fed-ff6d-4dfb-993b-512fa1fcaec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:52 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-bf25bffa-540d-4681-967f-e5da013eebeb tempest-VolumesDeleteCascade-2075360688 None] Created volume successfully. Sep 29 16:35:52 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-73673e02-2fe1-49df-b535-4d9d4104534d 1073741824" returned: 0 in 0.464s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-73673e02-2fe1-49df-b535-4d9d4104534d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:52 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-73673e02-2fe1-49df-b535-4d9d4104534d Sep 29 16:35:52 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:53 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-73673e02-2fe1-49df-b535-4d9d4104534d" returned: 0 in 0.288s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.696s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1614037703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04403e55-f239-4a48-900b-35c297d83129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882f4a435e0b447e9eadac24855891f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:46Z,use_quota=True,user_id='23b55561146e44f1ae42189b2fcc0cea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Creating volume 04403e55-f239-4a48-900b-35c297d83129 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:35:53 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed03a68-0e09-406f-9f0c-477cf618f67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73673e02-2fe1-49df-b535-4d9d4104534d', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a1a99e-8516-4ba5-9300-ee04ce77fce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:53 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 1073741824 Sep 29 16:35:53 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:53 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Volume volume-73673e02-2fe1-49df-b535-4d9d4104534d (73673e02-2fe1-49df-b535-4d9d4104534d): created successfully Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a1a99e-8516-4ba5-9300-ee04ce77fce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Flow 'volume_create_manager' (fa862e8c-12ea-43b7-89cf-815a0bab7040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:53 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-750a0e8f-d8b5-4125-a2f6-e5e48ba1b88e tempest-VolumesTestJSON-1388142674 None] Created volume successfully. Sep 29 16:35:53 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 1073741824" returned: 0 in 0.525s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-10bc15b8-b440-43af-9880-f91f16687271-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:53 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 Sep 29 16:35:53 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-10bc15b8-b440-43af-9880-f91f16687271-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Performing cascade delete. {{(pid=86793) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-4987a7d3-6e8c-4ccd-904f-5ac5798a3201-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-4987a7d3-6e8c-4ccd-904f-5ac5798a3201-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-quobyte-10bc15b8-b440-43af-9880-f91f16687271" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-10bc15b8-b440-43af-9880-f91f16687271" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-quobyte-4987a7d3-6e8c-4ccd-904f-5ac5798a3201" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-4987a7d3-6e8c-4ccd-904f-5ac5798a3201" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Deleting offline snapshot 4987a7d3-6e8c-4ccd-904f-5ac5798a3201 of volume 10bc15b8-b440-43af-9880-f91f16687271 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] snapshot_file for this snap is: volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d1d3be-a7f7-482d-8410-f5c06c086cb2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:54 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129" returned: 0 in 0.320s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:54 devstack sudo[92970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 Sep 29 16:35:54 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Attempting download of 041fad70-7851-4f49-af92-c1fc35c4c3b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}])) to volume 04403e55-f239-4a48-900b-35c297d83129. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6758e474-2b8f-4500-900e-72eb6c3e20ba]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2__xtjvnys {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:54 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2__xtjvnys Sep 29 16:35:54 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:54 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201" returned: 0 in 0.463s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10bc15b8-b440-43af-9880-f91f16687271(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d7351a-07d5-48b3-866e-27202e470f48]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:54 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 Sep 29 16:35:54 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:54 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2__xtjvnys" returned: 0 in 0.485s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2__xtjvnys {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:54 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2__xtjvnys Sep 29 16:35:54 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Flow 'volume_create_manager' (ef04bfd0-926b-4988-95bb-7a6c04ddc031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c22e6f-97cd-4541-b44b-17d2d54d3255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c22e6f-97cd-4541-b44b-17d2d54d3255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1869497702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfa2743-9353-4431-a814-43387eabacaa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b7e46cd8f5048bc86ce00bb0c651708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:55Z,use_quota=True,user_id='f102857dddef49eeb43880c1cfde23f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cdf412-32f7-4f87-a844-b6670d8c55c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cdf412-32f7-4f87-a844-b6670d8c55c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8dc3f4-dda3-4feb-b2e4-114472ac48bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8dc3f4-dda3-4feb-b2e4-114472ac48bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cfa2743-9353-4431-a814-43387eabacaa', 'volume_name': 'volume-4cfa2743-9353-4431-a814-43387eabacaa', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3a6eac-7f92-43e9-9b40-1a36b0dfa1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3a6eac-7f92-43e9-9b40-1a36b0dfa1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b296356b-5814-4d4c-aa3c-f39fab68b984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:54 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Volume 4cfa2743-9353-4431-a814-43387eabacaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cfa2743-9353-4431-a814-43387eabacaa', 'volume_size': 1} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1869497702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfa2743-9353-4431-a814-43387eabacaa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b7e46cd8f5048bc86ce00bb0c651708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:55Z,use_quota=True,user_id='f102857dddef49eeb43880c1cfde23f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Creating volume 4cfa2743-9353-4431-a814-43387eabacaa {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:35:54 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:35:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4cfa2743-9353-4431-a814-43387eabacaa 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:54 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4cfa2743-9353-4431-a814-43387eabacaa 1073741824 Sep 29 16:35:54 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:55 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2__xtjvnys" returned: 1 in 0.456s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2__xtjvnys' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2776447-092e-40e1-b8b4-b46287638541]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_k53pc_xgdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:55 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271" returned: 0 in 0.699s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:55 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 Sep 29 16:35:55 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:55 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_k53pc_xgdevstack@QuobyteHD Sep 29 16:35:55 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:55 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_k53pc_xgdevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] 041fad70-7851-4f49-af92-c1fc35c4c3b2 was qcow2, converting to qcow2 {{(pid=86793) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 16:35:55 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:55 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_k53pc_xgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201" returned: 0 in 0.413s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4cfa2743-9353-4431-a814-43387eabacaa 1073741824" returned: 0 in 0.592s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:55 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_k53pc_xgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 Sep 29 16:35:55 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:55 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201 Sep 29 16:35:55 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4cfa2743-9353-4431-a814-43387eabacaa {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:55 devstack sudo[93009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4cfa2743-9353-4431-a814-43387eabacaa Sep 29 16:35:55 devstack sudo[93009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:55 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271.4987a7d3-6e8c-4ccd-904f-5ac5798a3201" returned: 0 in 0.301s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-4987a7d3-6e8c-4ccd-904f-5ac5798a3201" released by "_delete_snapshot" :: held 2.017s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-10bc15b8-b440-43af-9880-f91f16687271" released by "delete_snapshot" :: held 2.049s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:55 devstack sudo[93009]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4cfa2743-9353-4431-a814-43387eabacaa" returned: 0 in 0.371s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:35:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b296356b-5814-4d4c-aa3c-f39fab68b984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cfa2743-9353-4431-a814-43387eabacaa', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ca9559-21e2-49ca-a31a-c02f76af4d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:56 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Created reservations ['81dd21b2-6b31-4dce-892a-b8b897181982', '6eb625e0-4e50-41de-8b8e-a56b02ecb61f', '9d41858c-6a85-4b44-b378-4f6ee4157e54', '07212b24-bbee-4358-990d-44b2280d23e5'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:35:56 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Volume volume-4cfa2743-9353-4431-a814-43387eabacaa (4cfa2743-9353-4431-a814-43387eabacaa): created successfully Sep 29 16:35:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ca9559-21e2-49ca-a31a-c02f76af4d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Flow 'volume_create_manager' (ef04bfd0-926b-4988-95bb-7a6c04ddc031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:56 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-456f9962-6740-474d-a1a9-ea1b04819dea tempest-VolumesTestJSON-1388142674 None] Created volume successfully. Sep 29 16:35:56 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Delete snapshot completed successfully. Sep 29 16:35:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-4987a7d3-6e8c-4ccd-904f-5ac5798a3201-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Snapshots deleted, issuing volume delete {{(pid=86793) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 29 16:35:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-quobyte-10bc15b8-b440-43af-9880-f91f16687271" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-10bc15b8-b440-43af-9880-f91f16687271" acquired by "delete_volume" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:56 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b895bf3b-299e-43fa-9eb1-b34f2a173edb]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:56 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 Sep 29 16:35:56 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:56 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271" returned: 0 in 0.495s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:56 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271 Sep 29 16:35:56 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:57 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10bc15b8-b440-43af-9880-f91f16687271" returned: 0 in 0.374s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-10bc15b8-b440-43af-9880-f91f16687271" released by "delete_volume" :: held 0.953s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Created reservations ['847986ed-8faa-481e-80c6-f3b340c071e5', 'cd08e82d-7ca7-4570-8523-0374ca30a81f', 'ee6e3cb1-e872-4fb7-9c62-0ccef0a14de8', '21c0326c-e0b7-48c8-9c15-83741833a5d2'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:57 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:35:57 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:57 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.369s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:35:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Deleted volume successfully. Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bc4d4a3a-1752-406d-b0d3-406ce2cf35b5 tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-10bc15b8-b440-43af-9880-f91f16687271-delete_volume" released by "delete_volume" :: held 3.970s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Flow 'volume_create_manager' (65c1333a-4fec-4aa2-91cd-2056d36184f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e42b89-92f4-45a4-8c69-dfa5e7b8ba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e42b89-92f4-45a4-8c69-dfa5e7b8ba87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1306128518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb52dead-2fdb-4403-bb71-87d738d087ea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b7e46cd8f5048bc86ce00bb0c651708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:58Z,use_quota=True,user_id='f102857dddef49eeb43880c1cfde23f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0679198c-be7c-4cc2-b8a7-472e9f9b817d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0679198c-be7c-4cc2-b8a7-472e9f9b817d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f337c20a-8458-4b44-90c2-108c9741088d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f337c20a-8458-4b44-90c2-108c9741088d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb52dead-2fdb-4403-bb71-87d738d087ea', 'volume_name': 'volume-eb52dead-2fdb-4403-bb71-87d738d087ea', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2dca45-802c-4582-8aad-6d700804cb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2dca45-802c-4582-8aad-6d700804cb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3d7aeb-7afd-4946-a02d-52b5a5cc6696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:57 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Volume eb52dead-2fdb-4403-bb71-87d738d087ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb52dead-2fdb-4403-bb71-87d738d087ea', 'volume_size': 1} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1306128518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb52dead-2fdb-4403-bb71-87d738d087ea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7b7e46cd8f5048bc86ce00bb0c651708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:35:58Z,use_quota=True,user_id='f102857dddef49eeb43880c1cfde23f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Creating volume eb52dead-2fdb-4403-bb71-87d738d087ea {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:35:57 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:35:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-eb52dead-2fdb-4403-bb71-87d738d087ea 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:57 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-eb52dead-2fdb-4403-bb71-87d738d087ea 1073741824 Sep 29 16:35:57 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:58 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_k53pc_xgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129" returned: 0 in 2.651s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_k53pc_xgdevstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:35:58 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Converted 112.00 MB image at 42.22 MB/s Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:58 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 1G Sep 29 16:35:58 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-2caa209a-3347-41ed-882b-80af03df12e9-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-2caa209a-3347-41ed-882b-80af03df12e9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "cinder-quobyte-2caa209a-3347-41ed-882b-80af03df12e9" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-2caa209a-3347-41ed-882b-80af03df12e9" acquired by "delete_volume" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56b092d-4703-441d-a315-a68971ecb2ed]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:58 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-eb52dead-2fdb-4403-bb71-87d738d087ea 1073741824" returned: 0 in 0.698s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-eb52dead-2fdb-4403-bb71-87d738d087ea {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:58 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-eb52dead-2fdb-4403-bb71-87d738d087ea Sep 29 16:35:58 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:58 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9 Sep 29 16:35:58 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:58 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 1G" returned: 0 in 0.560s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Downloaded image 041fad70-7851-4f49-af92-c1fc35c4c3b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}])) to volume 04403e55-f239-4a48-900b-35c297d83129 successfully. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Temporary image 041fad70-7851-4f49-af92-c1fc35c4c3b2 for user 23b55561146e44f1ae42189b2fcc0cea is deleted. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Marking volume 04403e55-f239-4a48-900b-35c297d83129 as bootable. {{(pid=86793) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Copying metadata from image 041fad70-7851-4f49-af92-c1fc35c4c3b2 to 04403e55-f239-4a48-900b-35c297d83129. {{(pid=86793) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Creating volume glance metadata for volume 04403e55-f239-4a48-900b-35c297d83129 backed by image 041fad70-7851-4f49-af92-c1fc35c4c3b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86793) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fcc0e9b-8800-48ef-b1c0-7715a8c20a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04403e55-f239-4a48-900b-35c297d83129', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114cf16a-0e68-451a-a43d-365845ab0779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:58 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Volume volume-04403e55-f239-4a48-900b-35c297d83129 (04403e55-f239-4a48-900b-35c297d83129): created successfully Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114cf16a-0e68-451a-a43d-365845ab0779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Flow 'volume_create_manager' (776571d5-59ae-41c4-8bbd-262c522d6ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:59 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-63860fe8-4fa4-4c86-81cc-5d94ed73ab0a tempest-ServerActionsTestOtherA-418642240 None] Created volume successfully. Sep 29 16:35:59 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9" returned: 0 in 0.532s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:59 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-eb52dead-2fdb-4403-bb71-87d738d087ea" returned: 0 in 0.475s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3d7aeb-7afd-4946-a02d-52b5a5cc6696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb52dead-2fdb-4403-bb71-87d738d087ea', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5049422-72e0-4312-9835-0a9e35db13c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:35:59 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9 Sep 29 16:35:59 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:35:59 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Volume volume-eb52dead-2fdb-4403-bb71-87d738d087ea (eb52dead-2fdb-4403-bb71-87d738d087ea): created successfully Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5049422-72e0-4312-9835-0a9e35db13c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Flow 'volume_create_manager' (65c1333a-4fec-4aa2-91cd-2056d36184f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:35:59 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-02600306-bf24-44b8-b983-6dd16addf4c4 tempest-VolumesTestJSON-1388142674 None] Created volume successfully. Sep 29 16:35:59 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2caa209a-3347-41ed-882b-80af03df12e9" returned: 0 in 0.394s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-quobyte-2caa209a-3347-41ed-882b-80af03df12e9" released by "delete_volume" :: held 1.000s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Created reservations ['a28e8eb8-5463-47ec-bd3e-d489f399348e', '6c3ff944-3d2f-4f44-a2f6-b7d1bbec1e87', 'e7f5b436-107e-49f3-9668-ec9dcb782df5', '358297e7-c40c-4257-b221-2315c4fa69c1'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:35:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:35:59 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:35:59 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:00 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.369s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:00 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:36:00 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Deleted volume successfully. Sep 29 16:36:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5659f1c3-e070-42d7-9e3a-02227d0add5f tempest-VolumesDeleteCascade-2075360688 None] Lock "cinder-2caa209a-3347-41ed-882b-80af03df12e9-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Acquiring lock "cinder-eb52dead-2fdb-4403-bb71-87d738d087ea-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:36:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Lock "cinder-eb52dead-2fdb-4403-bb71-87d738d087ea-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:36:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Acquiring lock "cinder-quobyte-eb52dead-2fdb-4403-bb71-87d738d087ea" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:36:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Lock "cinder-quobyte-eb52dead-2fdb-4403-bb71-87d738d087ea" acquired by "delete_volume" :: waited 0.031s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:36:01 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27b2d16-6a60-4c06-a981-66068b447243]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:36:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-eb52dead-2fdb-4403-bb71-87d738d087ea {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:01 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-eb52dead-2fdb-4403-bb71-87d738d087ea Sep 29 16:36:01 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:01 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-eb52dead-2fdb-4403-bb71-87d738d087ea" returned: 0 in 0.552s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-eb52dead-2fdb-4403-bb71-87d738d087ea {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:01 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-eb52dead-2fdb-4403-bb71-87d738d087ea Sep 29 16:36:01 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:02 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-eb52dead-2fdb-4403-bb71-87d738d087ea" returned: 0 in 0.449s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Lock "cinder-quobyte-eb52dead-2fdb-4403-bb71-87d738d087ea" released by "delete_volume" :: held 1.084s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:02 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=107,cinder:SELECT=94,cinder:INSERT=34,cinder:DELETE=11 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:36:02 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Created reservations ['458191b9-a959-46f9-9c9a-db140d96fb58', 'b459085f-7226-4eca-94d0-0fd95ead54cc', '5ba854b6-2778-45ef-b303-13b7fb9d081b', 'd358767d-1e6d-486d-b52b-20e89bcc298c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:36:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:36:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:36:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:02 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:36:02 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:03 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.548s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:03 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:36:03 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Deleted volume successfully. Sep 29 16:36:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9bc4cb65-923f-4384-a03b-a9aaa2ca6997 tempest-VolumesTestJSON-1388142674 None] Lock "cinder-eb52dead-2fdb-4403-bb71-87d738d087ea-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-8b207aa3-85e7-4186-8505-6dfca0005534 req-d847bb60-6c5b-4b08-8ae0-c90483a9416d tempest-ServerActionsTestOtherA-418642240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-8b207aa3-85e7-4186-8505-6dfca0005534 req-d847bb60-6c5b-4b08-8ae0-c90483a9416d tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-8b207aa3-85e7-4186-8505-6dfca0005534 req-d847bb60-6c5b-4b08-8ae0-c90483a9416d tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Acquiring lock "cinder-4cfa2743-9353-4431-a814-43387eabacaa-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:36:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-8b207aa3-85e7-4186-8505-6dfca0005534 req-d847bb60-6c5b-4b08-8ae0-c90483a9416d tempest-ServerActionsTestOtherA-418642240 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-04403e55-f239-4a48-900b-35c297d83129', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1b8bcbac-87a7-408d-8681-52c92cfbe8cb', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:36:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Lock "cinder-4cfa2743-9353-4431-a814-43387eabacaa-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:36:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Acquiring lock "cinder-quobyte-4cfa2743-9353-4431-a814-43387eabacaa" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:36:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Lock "cinder-quobyte-4cfa2743-9353-4431-a814-43387eabacaa" acquired by "delete_volume" :: waited 0.034s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:36:03 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-8b207aa3-85e7-4186-8505-6dfca0005534 req-d847bb60-6c5b-4b08-8ae0-c90483a9416d tempest-ServerActionsTestOtherA-418642240 None] attachment_update completed successfully. Sep 29 16:36:03 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[831371f7-9891-463c-9ae8-f0180a3df227]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:36:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4cfa2743-9353-4431-a814-43387eabacaa {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:03 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4cfa2743-9353-4431-a814-43387eabacaa Sep 29 16:36:03 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:04 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4cfa2743-9353-4431-a814-43387eabacaa" returned: 0 in 0.625s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4cfa2743-9353-4431-a814-43387eabacaa {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:04 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4cfa2743-9353-4431-a814-43387eabacaa Sep 29 16:36:04 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:04 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4cfa2743-9353-4431-a814-43387eabacaa" returned: 0 in 0.463s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Lock "cinder-quobyte-4cfa2743-9353-4431-a814-43387eabacaa" released by "delete_volume" :: held 1.177s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:04 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Created reservations ['19b482e0-8afe-4bf2-9271-259eaca3c4bc', 'fe0368fa-0bc6-421c-999f-aed70a3877ae', '9b4348ce-3b66-423d-b71f-a1f017dfdfa7', '87d6d751-88eb-4973-9aab-98b7a873f1c3'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:36:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:36:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:36:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:05 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:36:05 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:05 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.314s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:05 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:36:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Deleted volume successfully. Sep 29 16:36:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-467799da-6b50-4418-9f06-6ed59f8a1de4 tempest-VolumesTestJSON-1388142674 None] Lock "cinder-4cfa2743-9353-4431-a814-43387eabacaa-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Acquiring lock "cinder-73673e02-2fe1-49df-b535-4d9d4104534d-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:36:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Lock "cinder-73673e02-2fe1-49df-b535-4d9d4104534d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:36:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Acquiring lock "cinder-quobyte-73673e02-2fe1-49df-b535-4d9d4104534d" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:36:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Lock "cinder-quobyte-73673e02-2fe1-49df-b535-4d9d4104534d" acquired by "delete_volume" :: waited 0.027s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:36:06 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cbba3a-0b90-493f-95b9-7b76fd53fba4]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:36:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-73673e02-2fe1-49df-b535-4d9d4104534d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:06 devstack sudo[93201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-73673e02-2fe1-49df-b535-4d9d4104534d Sep 29 16:36:06 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:07 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-73673e02-2fe1-49df-b535-4d9d4104534d" returned: 0 in 0.692s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-73673e02-2fe1-49df-b535-4d9d4104534d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:07 devstack sudo[93207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-73673e02-2fe1-49df-b535-4d9d4104534d Sep 29 16:36:07 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:07 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-73673e02-2fe1-49df-b535-4d9d4104534d" returned: 0 in 0.515s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Lock "cinder-quobyte-73673e02-2fe1-49df-b535-4d9d4104534d" released by "delete_volume" :: held 1.302s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:07 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Created reservations ['be1cec8b-db41-438c-adba-70a101cc10d1', '46bd7667-c84e-4123-acd3-0c4f476f1bcf', 'dc47ac37-b26e-4202-a07c-e3ed7c1589c8', '2956d8d2-479c-4048-97a0-f88f91ab51e1'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:36:07 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:DELETE=9,cinder:UPDATE=121,cinder:SELECT=115,cinder:INSERT=38 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:36:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:36:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:36:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:08 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:36:08 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.633s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:08 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:36:08 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Deleted volume successfully. Sep 29 16:36:08 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:08 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-558961c9-d3d4-417f-b62c-29fe60eaf97f tempest-VolumesTestJSON-1388142674 None] Lock "cinder-73673e02-2fe1-49df-b535-4d9d4104534d-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Flow 'volume_create_manager' (cef9628d-2194-441a-bacd-b731615a5acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e13114-c88c-4809-89e0-a1282dea5152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e13114-c88c-4809-89e0-a1282dea5152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1193001813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8f7dc11b4841188c7db1ef4341d248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:10Z,use_quota=True,user_id='59d8ea4715df431cbe4394c0409cf724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d16567-02b2-4c15-a168-7ed66e95bccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d16567-02b2-4c15-a168-7ed66e95bccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ce93e5-27f9-4848-85e0-eeda282efcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ce93e5-27f9-4848-85e0-eeda282efcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4', 'volume_name': 'volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d045a2e0-091b-4e06-94fc-bc5e09fe9f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d045a2e0-091b-4e06-94fc-bc5e09fe9f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b220d2fc-d38b-46b1-8b5b-9d5ed7eec7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:10 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Volume 8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4', 'volume_size': 1} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1193001813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8f7dc11b4841188c7db1ef4341d248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:10Z,use_quota=True,user_id='59d8ea4715df431cbe4394c0409cf724',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Creating volume 8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:36:10 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:36:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:10 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4 1073741824 Sep 29 16:36:10 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:11 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4 1073741824" returned: 0 in 0.800s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:11 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4 Sep 29 16:36:11 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:11 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4" returned: 0 in 0.362s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:36:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b220d2fc-d38b-46b1-8b5b-9d5ed7eec7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a87d71-33f4-4413-ba0c-9cf479846300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:11 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Volume volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4 (8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4): created successfully Sep 29 16:36:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a87d71-33f4-4413-ba0c-9cf479846300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Flow 'volume_create_manager' (cef9628d-2194-441a-bacd-b731615a5acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:36:11 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-79f184fe-ecd2-4462-aa5b-8c366d40dd39 tempest-VolumesMetadataTest-1932144637 None] Created volume successfully. Sep 29 16:36:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Acquiring lock "cinder-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:36:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Lock "cinder-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:36:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Acquiring lock "cinder-quobyte-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:36:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Lock "cinder-quobyte-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4" acquired by "delete_volume" :: waited 0.021s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:36:14 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6508edec-151d-4007-834d-d9c9f2a02b69]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:36:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:14 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4 Sep 29 16:36:14 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:15 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4" returned: 0 in 0.590s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:15 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4 Sep 29 16:36:15 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:15 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4" returned: 0 in 0.522s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Lock "cinder-quobyte-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4" released by "delete_volume" :: held 1.202s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:15 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Created reservations ['5db2226f-5cb2-4447-96a7-b8890ee513ec', 'e4f79218-89da-4665-b7c3-0df8902f092e', '7f63ddaa-317e-431b-ae84-920f5b1008e8', '9950af7a-713b-43ac-b61b-cd673f0a601a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:36:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:36:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:36:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:16 devstack sudo[93739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:36:16 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:16 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.803s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:16 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:36:16 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Deleted volume successfully. Sep 29 16:36:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3cfe207a-a4ca-4eaf-bb27-b73818a6d8a5 tempest-VolumesMetadataTest-1932144637 None] Lock "cinder-8f6b6bf8-0f4c-46d4-a93c-de16d74fb7c4-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae7aaa-87a2-4b8f-a78d-f6a5e904880a tempest-BackendsCapabilitiesAdminTestsJSON-1077533813 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.01070022583, 'free_capacity_gb': 1775.01070022583, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86793) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 29 16:36:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-06110603-b253-498a-b819-fcdef1d09daf tempest-BackendsCapabilitiesAdminTestsJSON-1077533813 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.01070022583, 'free_capacity_gb': 1775.01070022583, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86793) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 29 16:36:26 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=8,cinder:UPDATE=13,cinder:INSERT=4 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:36:26 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:INSERT=6,cinder:UPDATE=41,cinder:SELECT=24,cinder:DELETE=4 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:36:29 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1ab55b0e-9fe3-4572-928e-d9ab0d0190b9 tempest-GroupSnapshotsTest-1461147352 None] Group tempest-GroupSnapshotsTest-Group-782935979: creating Sep 29 16:36:29 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1ab55b0e-9fe3-4572-928e-d9ab0d0190b9 tempest-GroupSnapshotsTest-1461147352 None] Group tempest-GroupSnapshotsTest-Group-782935979: created successfully Sep 29 16:36:29 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1ab55b0e-9fe3-4572-928e-d9ab0d0190b9 tempest-GroupSnapshotsTest-1461147352 None] Create group completed successfully. Sep 29 16:36:30 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-c6263881-8393-4b87-beeb-cb32eae8b5d5 req-ba3741b3-2076-4121-873f-9685d079a154 tempest-ServerActionsTestOtherA-418642240 None] Terminate volume connection completed successfully. Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-c6263881-8393-4b87-beeb-cb32eae8b5d5 req-ba3741b3-2076-4121-873f-9685d079a154 tempest-ServerActionsTestOtherA-418642240 None] Deleting attachment 1b8bcbac-87a7-408d-8681-52c92cfbe8cb. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Flow 'volume_create_manager' (77e6ef58-7d1c-4a4d-824f-cb10b2aec35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733611a9-2539-48ca-98cb-2982469f788b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733611a9-2539-48ca-98cb-2982469f788b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1020724265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c4cd60-2970-430d-ba84-b9b042dc6ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fe216960db4a2ea3c150f98adede9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:31Z,use_quota=True,user_id='2900674461c64e13b86635b8c933eec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b688fd75-ad54-4487-b6c6-372ae1027af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b688fd75-ad54-4487-b6c6-372ae1027af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f0bdb7-5c9d-47ee-8b18-1e6f6bcdbd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f0bdb7-5c9d-47ee-8b18-1e6f6bcdbd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c4cd60-2970-430d-ba84-b9b042dc6ae0', 'volume_name': 'volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41ac217-b1dc-4035-92f5-0f5c91beee65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f41ac217-b1dc-4035-92f5-0f5c91beee65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb140b4-25be-41e7-8f70-9952d5341691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:30 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Volume 20c4cd60-2970-430d-ba84-b9b042dc6ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0', 'volume_size': 1} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1020724265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c4cd60-2970-430d-ba84-b9b042dc6ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fe216960db4a2ea3c150f98adede9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:31Z,use_quota=True,user_id='2900674461c64e13b86635b8c933eec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Creating volume 20c4cd60-2970-430d-ba84-b9b042dc6ae0 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:36:30 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:36:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:30 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0 1073741824 Sep 29 16:36:30 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:31 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0 1073741824" returned: 0 in 0.738s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:31 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:36:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Flow 'volume_create_manager' (976b60bd-dffc-4427-9f8b-738687df9f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:36:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c42b34f-dcc2-41c8-b8a0-acfabb6f317c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c42b34f-dcc2-41c8-b8a0-acfabb6f317c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1361208320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a95f680c-88ec-46a3-a703-8f3264b6d440,host='devstack@QuobyteHD#QuobyteHD',id=bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06abe217738b4d4a9bffadf62cc1d549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:32Z,use_quota=True,user_id='c6fe022ee07f4906b42ada2e4c4785b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a37de613-279a-4cea-a0f7-87221cad4a4a),volume_type_id=a37de613-279a-4cea-a0f7-87221cad4a4a)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49e0476-6d4c-47bb-a271-54bf93e066b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49e0476-6d4c-47bb-a271-54bf93e066b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41b0239-dccd-4f37-bb20-f27800bce006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41b0239-dccd-4f37-bb20-f27800bce006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c', 'volume_name': 'volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d64179-37d5-4062-b8d0-701377f58454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d64179-37d5-4062-b8d0-701377f58454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04c2bfc-24df-4036-9a00-d6b38465b908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:31 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Volume bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c', 'volume_size': 1} Sep 29 16:36:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:31 devstack sudo[93866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0 Sep 29 16:36:31 devstack sudo[93866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-c6263881-8393-4b87-beeb-cb32eae8b5d5 req-ac68a1f3-b07b-4905-b65c-b288b3826b55 tempest-ServerActionsTestOtherA-418642240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:32 devstack sudo[93866]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0" returned: 0 in 0.351s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.379s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a95f680c-88ec-46a3-a703-8f3264b6d440,created_at=2026-09-29T14:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1361208320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a95f680c-88ec-46a3-a703-8f3264b6d440,host='devstack@QuobyteHD#QuobyteHD',id=bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06abe217738b4d4a9bffadf62cc1d549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:32Z,use_quota=True,user_id='c6fe022ee07f4906b42ada2e4c4785b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a37de613-279a-4cea-a0f7-87221cad4a4a),volume_type_id=a37de613-279a-4cea-a0f7-87221cad4a4a)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Creating volume bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:36:32 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb140b4-25be-41e7-8f70-9952d5341691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:32 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c 1073741824 Sep 29 16:36:32 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4609f99-c21e-4854-8155-c5a02527b431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:32 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Volume volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0 (20c4cd60-2970-430d-ba84-b9b042dc6ae0): created successfully Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4609f99-c21e-4854-8155-c5a02527b431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Flow 'volume_create_manager' (77e6ef58-7d1c-4a4d-824f-cb10b2aec35c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:36:32 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b547fd66-003d-4c7c-97be-c0f66a9c240e tempest-AttachVolumeTestJSON-1343189258 None] Created volume successfully. Sep 29 16:36:32 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c 1073741824" returned: 0 in 0.475s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:32 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c Sep 29 16:36:32 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:32 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c" returned: 0 in 0.283s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-c6263881-8393-4b87-beeb-cb32eae8b5d5 req-ac68a1f3-b07b-4905-b65c-b288b3826b55 tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.907s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04c2bfc-24df-4036-9a00-d6b38465b908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fe63bc-d39d-442b-970d-f5eed11a6733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-c6263881-8393-4b87-beeb-cb32eae8b5d5 req-ac68a1f3-b07b-4905-b65c-b288b3826b55 tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:32 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Volume volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c (bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c): created successfully Sep 29 16:36:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0fe63bc-d39d-442b-970d-f5eed11a6733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Flow 'volume_create_manager' (976b60bd-dffc-4427-9f8b-738687df9f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:36:33 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-d3619ab3-7e15-45d0-89e4-1f956112fd84 tempest-GroupSnapshotsTest-1461147352 None] Created volume successfully. Sep 29 16:36:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-c6263881-8393-4b87-beeb-cb32eae8b5d5 req-ac68a1f3-b07b-4905-b65c-b288b3826b55 tempest-ServerActionsTestOtherA-418642240 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-04403e55-f239-4a48-900b-35c297d83129', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53cd0bb0-75a8-4007-921a-92ccb5b79dc8', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:36:33 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-c6263881-8393-4b87-beeb-cb32eae8b5d5 req-ac68a1f3-b07b-4905-b65c-b288b3826b55 tempest-ServerActionsTestOtherA-418642240 None] attachment_update completed successfully. Sep 29 16:36:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-9a0c20de-1cba-43fa-9bc1-436ce0bfd891 req-00fab1a4-9ba6-4e02-baab-64213a17f93b tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-9a0c20de-1cba-43fa-9bc1-436ce0bfd891 req-00fab1a4-9ba6-4e02-baab-64213a17f93b tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-9a0c20de-1cba-43fa-9bc1-436ce0bfd891 req-00fab1a4-9ba6-4e02-baab-64213a17f93b tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-9a0c20de-1cba-43fa-9bc1-436ce0bfd891 req-00fab1a4-9ba6-4e02-baab-64213a17f93b tempest-AttachVolumeTestJSON-1343189258 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '626bd244-3947-407e-bc33-59a1a16e6ef8', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:36:34 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-9a0c20de-1cba-43fa-9bc1-436ce0bfd891 req-00fab1a4-9ba6-4e02-baab-64213a17f93b tempest-AttachVolumeTestJSON-1343189258 None] attachment_update completed successfully. Sep 29 16:36:34 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] GroupSnapshot 32477add-3dae-4fca-84c2-e9ba9fe0ee92: creating. Sep 29 16:36:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] Group snapshot 32477add-3dae-4fca-84c2-e9ba9fe0ee92: creating. {{(pid=86793) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 16:36:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] Creating offline snapshot 1b7541d2-0685-4465-8624-7a0206db3a91 of volume bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:36:34 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad3dc32-0adb-44fe-9719-b6cd1ce2651c]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:36:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:34 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c Sep 29 16:36:34 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:36:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:36:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:36:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:34 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:36:34 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:35 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c" returned: 0 in 0.596s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:35 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 1G Sep 29 16:36:35 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:35 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.499s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:36:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:36:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:36:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:36:35 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 1G" returned: 0 in 0.683s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:35 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 Sep 29 16:36:35 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:36 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91" returned: 0 in 0.499s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:36 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 16:36:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:36 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 Sep 29 16:36:36 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:36 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91" returned: 0 in 0.385s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:36 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.info Sep 29 16:36:36 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:36 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:36:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Flow 'volume_create_manager' (51ebe3bd-549f-47f5-bc69-a7db2788ad8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:36:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5de4784-daa4-4015-9866-be1cd3bbd182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5de4784-daa4-4015-9866-be1cd3bbd182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1427519583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fe216960db4a2ea3c150f98adede9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:37Z,use_quota=True,user_id='2900674461c64e13b86635b8c933eec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb7319b-1b30-46a7-9b98-ff89832f8a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb7319b-1b30-46a7-9b98-ff89832f8a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa97d8a-2eea-439b-bafa-eb228144aeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa97d8a-2eea-439b-bafa-eb228144aeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5', 'volume_name': 'volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579801be-6d15-4c76-a41b-b3930de32ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579801be-6d15-4c76-a41b-b3930de32ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63f17db-fded-4288-b47e-99c9c56d51d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:37 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Volume c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5', 'volume_size': 1} Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:37 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.info" returned: 0 in 0.302s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:37 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:37 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.info Sep 29 16:36:37 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:37 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.info" returned: 0 in 0.282s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.923s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.399s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1427519583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fe216960db4a2ea3c150f98adede9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:37Z,use_quota=True,user_id='2900674461c64e13b86635b8c933eec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Creating volume c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:36:37 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:36:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:37 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5 1073741824 Sep 29 16:36:37 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:37 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a982938f-f9b3-4ace-a265-d32b79df3b16 tempest-GroupSnapshotsTest-1461147352 None] group_snapshot 32477add-3dae-4fca-84c2-e9ba9fe0ee92: created successfully Sep 29 16:36:38 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5 1073741824" returned: 0 in 1.004s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:38 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5 Sep 29 16:36:38 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:39 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5" returned: 0 in 0.599s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.238s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-1b7541d2-0685-4465-8624-7a0206db3a91-47dc9abb-a287-485c-a2a4-9feade747b33" by "_create_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63f17db-fded-4288-b47e-99c9c56d51d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec09635e-714d-483c-a884-dedbba7e32a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-1b7541d2-0685-4465-8624-7a0206db3a91-47dc9abb-a287-485c-a2a4-9feade747b33" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Creating volume 47dc9abb-a287-485c-a2a4-9feade747b33 from snapshot 1b7541d2-0685-4465-8624-7a0206db3a91 {{(pid=86793) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-47dc9abb-a287-485c-a2a4-9feade747b33" by "_copy_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:36:39 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Volume volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5 (c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5): created successfully Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec09635e-714d-483c-a884-dedbba7e32a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Flow 'volume_create_manager' (51ebe3bd-549f-47f5-bc69-a7db2788ad8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-47dc9abb-a287-485c-a2a4-9feade747b33" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] snapshot: 1b7541d2-0685-4465-8624-7a0206db3a91, volume: 47dc9abb-a287-485c-a2a4-9feade747b33, {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 16:36:39 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b4c63676-0554-47b7-8c46-ef937f87fc35 tempest-AttachVolumeTestJSON-1343189258 None] Created volume successfully. Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9e79f3-5a4e-46a9-9641-6f4dc10d89e5]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:36:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:39 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 Sep 29 16:36:39 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:40 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91" returned: 0 in 0.926s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:40 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:36:40 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f689115-1704-4eac-84c0-4c51276b8c85]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:36:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:40 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c Sep 29 16:36:40 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:41 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c" returned: 0 in 0.879s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 16:36:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Creating direct copy from snapshot {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 16:36:41 devstack cinder-volume[86793]: DEBUG cinder.utils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Path /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33 not found in is_blk_device check {{(pid=86793) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 16:36:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:41 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33 Sep 29 16:36:41 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-04a9ccaa-98f9-40ab-ad33-f94c1a7379b8 req-6619b49d-d7e5-4821-866f-588badb5ec6d tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:43 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:36:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Flow 'volume_create_manager' (d69c8c6f-a017-44ff-929b-cad01c69d001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:36:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c078f4d-1341-4de4-a6f8-3f0a26b3b8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c078f4d-1341-4de4-a6f8-3f0a26b3b8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-230749554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf915a89-d911-4a22-a455-456387af1b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0d539b68a542c4a4433cd6526216ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:44Z,use_quota=True,user_id='327e741d2a8347ed8c4ee2c83b0d285d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea809c9-e10e-4cc0-aefc-b6500296950e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea809c9-e10e-4cc0-aefc-b6500296950e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ec8b36-99b6-42c0-99ae-3bc78bd9935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ec8b36-99b6-42c0-99ae-3bc78bd9935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf915a89-d911-4a22-a455-456387af1b79', 'volume_name': 'volume-cf915a89-d911-4a22-a455-456387af1b79', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71326ec3-5b9f-4e1a-8d44-adf4306dac1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71326ec3-5b9f-4e1a-8d44-adf4306dac1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d93974-63af-4b45-b9b6-504fd4775f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:44 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Volume cf915a89-d911-4a22-a455-456387af1b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf915a89-d911-4a22-a455-456387af1b79', 'volume_size': 1} Sep 29 16:36:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:50 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33" returned: 0 in 9.249s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c, size 1024.00 MB, duration 9.25 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:36:50 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Converted 1024.00 MB image at 110.70 MB/s Sep 29 16:36:50 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:50 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33 Sep 29 16:36:50 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:50 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33" returned: 0 in 0.262s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-47dc9abb-a287-485c-a2a4-9feade747b33" released by "_copy_volume_from_snapshot" :: held 11.493s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-1b7541d2-0685-4465-8624-7a0206db3a91-47dc9abb-a287-485c-a2a4-9feade747b33" released by "_create_volume_from_snapshot" :: held 11.598s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.651s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-04a9ccaa-98f9-40ab-ad33-f94c1a7379b8 req-6619b49d-d7e5-4821-866f-588badb5ec6d tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.913s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-04a9ccaa-98f9-40ab-ad33-f94c1a7379b8 req-6619b49d-d7e5-4821-866f-588badb5ec6d tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.637s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-230749554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf915a89-d911-4a22-a455-456387af1b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab0d539b68a542c4a4433cd6526216ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:36:44Z,use_quota=True,user_id='327e741d2a8347ed8c4ee2c83b0d285d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Creating volume cf915a89-d911-4a22-a455-456387af1b79 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:36:50 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:50 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 1073741824 Sep 29 16:36:50 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-04a9ccaa-98f9-40ab-ad33-f94c1a7379b8 req-6619b49d-d7e5-4821-866f-588badb5ec6d tempest-AttachVolumeTestJSON-1343189258 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50535367-447e-4f24-b3cf-39a3c8de4102', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:36:50 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-674b3009-2205-469d-9a3e-3d9f5f92543b tempest-GroupSnapshotsTest-1461147352 None] Create group from source-snapshot-32477add-3dae-4fca-84c2-e9ba9fe0ee92 completed successfully. Sep 29 16:36:50 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-04a9ccaa-98f9-40ab-ad33-f94c1a7379b8 req-6619b49d-d7e5-4821-866f-588badb5ec6d tempest-AttachVolumeTestJSON-1343189258 None] attachment_update completed successfully. Sep 29 16:36:51 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 1073741824" returned: 0 in 0.506s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:51 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 Sep 29 16:36:51 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:51 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79" returned: 0 in 0.370s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:36:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d93974-63af-4b45-b9b6-504fd4775f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf915a89-d911-4a22-a455-456387af1b79', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88443f0c-ef65-44be-aeec-42c0c85ceb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:36:51 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Volume volume-cf915a89-d911-4a22-a455-456387af1b79 (cf915a89-d911-4a22-a455-456387af1b79): created successfully Sep 29 16:36:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88443f0c-ef65-44be-aeec-42c0c85ceb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:36:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Flow 'volume_create_manager' (d69c8c6f-a017-44ff-929b-cad01c69d001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:36:51 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ef28321c-f0f9-4d9e-841d-ec27cee366be tempest-VolumesActionsTest-2117664832 None] Created volume successfully. Sep 29 16:36:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-47dc9abb-a287-485c-a2a4-9feade747b33" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:36:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-47dc9abb-a287-485c-a2a4-9feade747b33" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:36:52 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b343bdd-f372-464b-9dfa-51d915a48381]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:36:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:52 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33 Sep 29 16:36:52 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:52 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33" returned: 0 in 0.393s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:52 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33 Sep 29 16:36:52 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:52 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47dc9abb-a287-485c-a2a4-9feade747b33" returned: 0 in 0.369s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-47dc9abb-a287-485c-a2a4-9feade747b33" released by "delete_volume" :: held 0.828s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:52 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Created reservations ['0b2ea488-55b2-4db2-9a95-9d2ce9ded1d5'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:36:53 devstack cinder-volume[86793]: WARNING cinder.quota [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2032141030 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2032141030, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:36:53 devstack cinder-volume[86793]: WARNING cinder.quota [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2032141030 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2032141030, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Created reservations ['49e5dee5-eb07-4df2-8581-cdc8d2dd7bb2', 'ecef852e-cc39-4910-9149-d4afea17e628', 'ecb9caf9-07cf-4044-a2ea-5684ae9b9f11', 'f858b0fe-6a3d-423f-a8e6-585a52bab696'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:53 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:36:53 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:53 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] group_snapshot 32477add-3dae-4fca-84c2-e9ba9fe0ee92: deleting Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] group_snapshot 32477add-3dae-4fca-84c2-e9ba9fe0ee92: deleting {{(pid=86793) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-1b7541d2-0685-4465-8624-7a0206db3a91" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-1b7541d2-0685-4465-8624-7a0206db3a91" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] Deleting offline snapshot 1b7541d2-0685-4465-8624-7a0206db3a91 of volume bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] snapshot_file for this snap is: volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9354ac50-d4c4-4cc1-a5f0-ea92285486a5]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:53 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.652s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:53 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:36:53 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-42bc4063-6db2-4a23-8a6d-da2cb425e267 tempest-GroupSnapshotsTest-1461147352 None] Delete group completed successfully. Sep 29 16:36:54 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 Sep 29 16:36:54 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:54 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-2b67851d-66c9-4396-8811-2c3dad89ff00 req-01c387cf-d55e-492d-9a7c-4790828c4570 tempest-AttachVolumeTestJSON-1343189258 None] Terminate volume connection completed successfully. Sep 29 16:36:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-2b67851d-66c9-4396-8811-2c3dad89ff00 req-01c387cf-d55e-492d-9a7c-4790828c4570 tempest-AttachVolumeTestJSON-1343189258 None] Deleting attachment 626bd244-3947-407e-bc33-59a1a16e6ef8. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:36:54 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91" returned: 0 in 0.727s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:36:54 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc07881a-b85e-4af1-a30f-8d7faa68392b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:36:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:54 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c Sep 29 16:36:54 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:55 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c" returned: 0 in 0.742s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:55 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 Sep 29 16:36:55 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:55 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:55 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-ec666607-5c62-4635-b593-aa28bc5559b4 req-8fd53de6-befe-4a2e-ab8b-0fe574f9058d tempest-AttachVolumeTestJSON-1343189258 None] Terminate volume connection completed successfully. Sep 29 16:36:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-ec666607-5c62-4635-b593-aa28bc5559b4 req-8fd53de6-befe-4a2e-ab8b-0fe574f9058d tempest-AttachVolumeTestJSON-1343189258 None] Deleting attachment 50535367-447e-4f24-b3cf-39a3c8de4102. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:36:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91" returned: 0 in 0.473s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:55 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91 Sep 29 16:36:55 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:56 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c.1b7541d2-0685-4465-8624-7a0206db3a91" returned: 0 in 0.492s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-1b7541d2-0685-4465-8624-7a0206db3a91" released by "_delete_snapshot" :: held 2.638s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c" released by "delete_snapshot" :: held 2.707s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:56 devstack cinder-volume[86793]: WARNING cinder.quota [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2032141030 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2032141030, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:36:56 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] Created reservations ['041b1964-2526-443d-841a-11c5fd8c3846', 'f50fe12a-82bd-4a97-a917-dc2ebf36dc9d', '45b07c69-397e-4ffa-a2db-816faa9471cb', '74940467-3bef-466f-bebf-e9ace9f1b3e8'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:36:56 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7cc5360f-ad86-4894-8d71-0261d25ff882 tempest-GroupSnapshotsTest-1461147352 None] group_snapshot 32477add-3dae-4fca-84c2-e9ba9fe0ee92: deleted successfully Sep 29 16:36:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:36:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c" acquired by "delete_volume" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:36:57 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[374e32eb-0bc6-478e-a782-c9bc28e92f93]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:36:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:57 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c Sep 29 16:36:57 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:58 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c" returned: 0 in 0.509s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:58 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c Sep 29 16:36:58 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:58 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c" returned: 0 in 0.295s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-bbd0a7e1-7eb8-486d-8c8b-43743bb1fa6c" released by "delete_volume" :: held 0.917s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:36:58 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Created reservations ['fb836590-79dc-4896-99a2-74c08545fcd0'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:36:58 devstack cinder-volume[86793]: WARNING cinder.db.api [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2032141030'] Sep 29 16:36:58 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Created reservations ['deb21cf9-a4d1-4eb0-ba4b-f2fd245b1bdd', 'e2493761-ff57-4dac-8644-654abfc68f53', 'e2bca0fe-607d-4eda-8646-cd78364fc1ab', '40a35439-e0e0-4f58-b199-f2ce69683cef'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:36:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:36:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:36:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:36:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:36:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:36:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:36:58 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:36:58 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:36:59 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Sep 29 16:36:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.311s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:36:59 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:36:59 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3aa1783d-47b9-4d43-b7e1-50a37b663dc9 tempest-GroupSnapshotsTest-1461147352 None] Delete group completed successfully. Sep 29 16:37:00 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c4b9b816-086b-483a-bc4a-48693bf9060b tempest-GroupSnapshotsTest-1461147352 None] Group tempest-GroupSnapshotsTest-Group-1656303882: creating Sep 29 16:37:00 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c4b9b816-086b-483a-bc4a-48693bf9060b tempest-GroupSnapshotsTest-1461147352 None] Group tempest-GroupSnapshotsTest-Group-1656303882: created successfully Sep 29 16:37:00 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c4b9b816-086b-483a-bc4a-48693bf9060b tempest-GroupSnapshotsTest-1461147352 None] Create group completed successfully. Sep 29 16:37:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "cinder-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Lock "cinder-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "cinder-quobyte-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Lock "cinder-quobyte-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5" acquired by "delete_volume" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d29ea4-0a17-49f7-9f5f-dc3c3ddf3e05]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:02 devstack sudo[94695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5 Sep 29 16:37:02 devstack sudo[94695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Flow 'volume_create_manager' (c28e62c3-b43c-4319-a347-2cd099ee3bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31848086-abc1-45e3-9308-18d951b92c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31848086-abc1-45e3-9308-18d951b92c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-565355693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1005eb38-910e-4af5-b77d-fc1b7b504416,host='devstack@QuobyteHD#QuobyteHD',id=9c02c8f1-f4ce-4400-a06c-311b032417f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06abe217738b4d4a9bffadf62cc1d549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:03Z,use_quota=True,user_id='c6fe022ee07f4906b42ada2e4c4785b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(653bd8ba-cbdd-49ad-8522-460e42328235),volume_type_id=653bd8ba-cbdd-49ad-8522-460e42328235)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:02 devstack sudo[94695]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49f30cf-aa6a-4907-91e6-6f20baec7f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49f30cf-aa6a-4907-91e6-6f20baec7f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84d1524-6ba4-42ef-8531-de97b55c4d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84d1524-6ba4-42ef-8531-de97b55c4d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c02c8f1-f4ce-4400-a06c-311b032417f0', 'volume_name': 'volume-9c02c8f1-f4ce-4400-a06c-311b032417f0', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3a4a1a-5bde-4160-9446-ab888f7aa3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d3a4a1a-5bde-4160-9446-ab888f7aa3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ab1831-4ef6-4a55-aa8d-f3aaeeb99fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:02 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Volume 9c02c8f1-f4ce-4400-a06c-311b032417f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c02c8f1-f4ce-4400-a06c-311b032417f0', 'volume_size': 1} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1005eb38-910e-4af5-b77d-fc1b7b504416,created_at=2026-09-29T14:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-565355693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1005eb38-910e-4af5-b77d-fc1b7b504416,host='devstack@QuobyteHD#QuobyteHD',id=9c02c8f1-f4ce-4400-a06c-311b032417f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06abe217738b4d4a9bffadf62cc1d549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:03Z,use_quota=True,user_id='c6fe022ee07f4906b42ada2e4c4785b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(653bd8ba-cbdd-49ad-8522-460e42328235),volume_type_id=653bd8ba-cbdd-49ad-8522-460e42328235)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Creating volume 9c02c8f1-f4ce-4400-a06c-311b032417f0 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:37:02 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5" returned: 0 in 0.801s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:02 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 1073741824 Sep 29 16:37:02 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:02 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5 Sep 29 16:37:02 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:03 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5" returned: 0 in 0.611s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Lock "cinder-quobyte-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5" released by "delete_volume" :: held 1.480s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:03 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Created reservations ['8a80611f-8156-43f2-88bd-ee175d90503b', 'e67aaf43-42f9-412d-b369-456057e7e83e', '93f21023-3e0d-4c81-b771-36b19b524f8c', '0b8c1d02-624d-458d-8dba-6df7b31f48d0'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:37:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:37:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:37:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:37:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:37:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:03 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:37:03 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:03 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 1073741824" returned: 0 in 0.921s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:03 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 Sep 29 16:37:03 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:04 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.490s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:37:04 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Deleted volume successfully. Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2bae16a1-71a8-4510-90bf-24024017845d tempest-AttachVolumeTestJSON-1343189258 None] Lock "cinder-c3f9daf4-9a3f-463b-a510-2cb5ff99f5d5-delete_volume" released by "delete_volume" :: held 2.302s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "cinder-20c4cd60-2970-430d-ba84-b9b042dc6ae0-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:04 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Lock "cinder-20c4cd60-2970-430d-ba84-b9b042dc6ae0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0" returned: 0 in 0.650s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ab1831-4ef6-4a55-aa8d-f3aaeeb99fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c02c8f1-f4ce-4400-a06c-311b032417f0', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436ee282-1225-465a-9a27-6868bef36223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "cinder-quobyte-20c4cd60-2970-430d-ba84-b9b042dc6ae0" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:04 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Volume volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 (9c02c8f1-f4ce-4400-a06c-311b032417f0): created successfully Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436ee282-1225-465a-9a27-6868bef36223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Flow 'volume_create_manager' (c28e62c3-b43c-4319-a347-2cd099ee3bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:37:04 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c393f6f0-41c1-4ca1-a4f2-b271f1b23dce tempest-GroupSnapshotsTest-1461147352 None] Created volume successfully. Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Lock "cinder-quobyte-20c4cd60-2970-430d-ba84-b9b042dc6ae0" acquired by "delete_volume" :: waited 0.060s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-108080c9-5f3e-4962-ac11-f336e057aa1a tempest-VolumesActionsTest-2117664832 None] Acquiring lock "cinder-cf915a89-d911-4a22-a455-456387af1b79" by "attach_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9fc1e3-1988-4a06-b58f-0e2e2de7e236]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-108080c9-5f3e-4962-ac11-f336e057aa1a tempest-VolumesActionsTest-2117664832 None] Lock "cinder-cf915a89-d911-4a22-a455-456387af1b79" acquired by "attach_volume" :: waited 0.043s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:04 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-108080c9-5f3e-4962-ac11-f336e057aa1a tempest-VolumesActionsTest-2117664832 None] Attaching volume cf915a89-d911-4a22-a455-456387af1b79 to instance d295e188-53cd-4dc6-9b16-cd73c3f309d3 at mountpoint /dev/vdb on host None. Sep 29 16:37:04 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0 Sep 29 16:37:04 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:04 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-108080c9-5f3e-4962-ac11-f336e057aa1a tempest-VolumesActionsTest-2117664832 None] Attach volume completed successfully. Sep 29 16:37:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-108080c9-5f3e-4962-ac11-f336e057aa1a tempest-VolumesActionsTest-2117664832 None] Lock "cinder-cf915a89-d911-4a22-a455-456387af1b79" released by "attach_volume" :: held 0.149s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5328636e-5f21-4c35-abb3-6565e0601f1c tempest-VolumesActionsTest-2117664832 None] Acquiring lock "cinder-cf915a89-d911-4a22-a455-456387af1b79-detach_volume" by "detach_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5328636e-5f21-4c35-abb3-6565e0601f1c tempest-VolumesActionsTest-2117664832 None] Lock "cinder-cf915a89-d911-4a22-a455-456387af1b79-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5328636e-5f21-4c35-abb3-6565e0601f1c tempest-VolumesActionsTest-2117664832 None] Detaching volume cf915a89-d911-4a22-a455-456387af1b79 from instance d295e188-53cd-4dc6-9b16-cd73c3f309d3. Sep 29 16:37:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5328636e-5f21-4c35-abb3-6565e0601f1c tempest-VolumesActionsTest-2117664832 None] Detach volume completed successfully. Sep 29 16:37:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5328636e-5f21-4c35-abb3-6565e0601f1c tempest-VolumesActionsTest-2117664832 None] Lock "cinder-cf915a89-d911-4a22-a455-456387af1b79-detach_volume" released by "detach_volume" :: held 0.129s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:05 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0" returned: 0 in 0.481s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:05 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0 Sep 29 16:37:05 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:05 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-20c4cd60-2970-430d-ba84-b9b042dc6ae0" returned: 0 in 0.538s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Lock "cinder-quobyte-20c4cd60-2970-430d-ba84-b9b042dc6ae0" released by "delete_volume" :: held 1.135s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:05 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Created reservations ['3ea9ded9-b0a7-48b1-af9f-9d0ca46606a0', '516d5cc3-53d4-4703-88d6-d36c92405115', '30475229-ad85-450a-beeb-593c047dfeb3', 'e8a2b9f0-7399-46e8-9a92-514696c5c432'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:37:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:37:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:37:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:37:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:37:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:06 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:37:06 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:06 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.610s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:37:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Deleted volume successfully. Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c84d12ed-594b-4472-988c-1d0097496d17 tempest-AttachVolumeTestJSON-1343189258 None] Lock "cinder-20c4cd60-2970-430d-ba84-b9b042dc6ae0-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Flow 'volume_create_manager' (2960f83e-3ec9-4706-bd52-c084d80cfe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251f1be9-0fe8-484a-ad80-fee980309852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251f1be9-0fe8-484a-ad80-fee980309852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1787660253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1005eb38-910e-4af5-b77d-fc1b7b504416,host='devstack@QuobyteHD#QuobyteHD',id=4f249cf5-3c20-409a-9bb3-1369b72893c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06abe217738b4d4a9bffadf62cc1d549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:07Z,use_quota=True,user_id='c6fe022ee07f4906b42ada2e4c4785b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(653bd8ba-cbdd-49ad-8522-460e42328235),volume_type_id=653bd8ba-cbdd-49ad-8522-460e42328235)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9607cd48-5921-4a4e-a8bb-d22f0eb41f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9607cd48-5921-4a4e-a8bb-d22f0eb41f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0f21af-87ef-4938-9821-4691dc59cdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce0f21af-87ef-4938-9821-4691dc59cdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f249cf5-3c20-409a-9bb3-1369b72893c9', 'volume_name': 'volume-4f249cf5-3c20-409a-9bb3-1369b72893c9', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6c0054-829c-4299-a311-5a3a1cc33618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6c0054-829c-4299-a311-5a3a1cc33618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c97328d-a307-48d0-be14-9cf31cf7b19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:06 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Volume 4f249cf5-3c20-409a-9bb3-1369b72893c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f249cf5-3c20-409a-9bb3-1369b72893c9', 'volume_size': 1} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1005eb38-910e-4af5-b77d-fc1b7b504416,created_at=2026-09-29T14:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1787660253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1005eb38-910e-4af5-b77d-fc1b7b504416,host='devstack@QuobyteHD#QuobyteHD',id=4f249cf5-3c20-409a-9bb3-1369b72893c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06abe217738b4d4a9bffadf62cc1d549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:07Z,use_quota=True,user_id='c6fe022ee07f4906b42ada2e4c4785b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(653bd8ba-cbdd-49ad-8522-460e42328235),volume_type_id=653bd8ba-cbdd-49ad-8522-460e42328235)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Creating volume 4f249cf5-3c20-409a-9bb3-1369b72893c9 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:37:06 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:37:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:06 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 1073741824 Sep 29 16:37:06 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "cinder-0378ce7e-f1bc-4f9a-acce-35f1b4f60425-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Lock "cinder-0378ce7e-f1bc-4f9a-acce-35f1b4f60425-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "cinder-quobyte-0378ce7e-f1bc-4f9a-acce-35f1b4f60425" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Lock "cinder-quobyte-0378ce7e-f1bc-4f9a-acce-35f1b4f60425" acquired by "delete_volume" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:07 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba9bc31-56a0-4858-a04d-4af876aa04ba]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:07 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425 Sep 29 16:37:07 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:07 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 1073741824" returned: 0 in 0.865s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:07 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 Sep 29 16:37:07 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:08 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425" returned: 0 in 0.797s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:08 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425 Sep 29 16:37:08 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:08 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9" returned: 0 in 0.504s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c97328d-a307-48d0-be14-9cf31cf7b19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f249cf5-3c20-409a-9bb3-1369b72893c9', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2df7474-021c-460f-b19a-d7d212401004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:08 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Volume volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 (4f249cf5-3c20-409a-9bb3-1369b72893c9): created successfully Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2df7474-021c-460f-b19a-d7d212401004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Flow 'volume_create_manager' (2960f83e-3ec9-4706-bd52-c084d80cfe5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:37:08 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-41811efe-41c5-4304-9759-c5da0b501f9f tempest-GroupSnapshotsTest-1461147352 None] Created volume successfully. Sep 29 16:37:08 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0378ce7e-f1bc-4f9a-acce-35f1b4f60425" returned: 0 in 0.371s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Lock "cinder-quobyte-0378ce7e-f1bc-4f9a-acce-35f1b4f60425" released by "delete_volume" :: held 1.248s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Created reservations ['2e475e1e-aae3-40bf-a90c-a445fd5437d6', '742b1bdf-2cc0-438c-8fd1-02b0ca8895a4', '1c744bc0-c24b-4ab6-aad1-6c8c349cf32f', 'd5878839-9a5d-4b51-b2dc-564e8e06ff9d'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:37:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:08 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:37:08 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:09 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.358s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:09 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:37:09 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Deleted volume successfully. Sep 29 16:37:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7fb0156f-bcb8-47f4-a0f0-ed8abb884757 tempest-AttachVolumeTestJSON-1343189258 None] Lock "cinder-0378ce7e-f1bc-4f9a-acce-35f1b4f60425-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:09 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-82166cf4-9381-4ec6-b16f-ac6994796e27 tempest-GroupSnapshotsTest-1461147352 None] Update group completed successfully. Sep 29 16:37:09 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-94b05240-a90d-4e7c-8488-bd66926fe840 tempest-ServerActionsTestOtherA-418642240 None] Terminate volume connection completed successfully. Sep 29 16:37:09 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-94b05240-a90d-4e7c-8488-bd66926fe840 tempest-ServerActionsTestOtherA-418642240 None] Deleting attachment 53cd0bb0-75a8-4007-921a-92ccb5b79dc8. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:37:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Acquiring lock "cinder-04403e55-f239-4a48-900b-35c297d83129-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Lock "cinder-04403e55-f239-4a48-900b-35c297d83129-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Acquiring lock "cinder-quobyte-04403e55-f239-4a48-900b-35c297d83129" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Lock "cinder-quobyte-04403e55-f239-4a48-900b-35c297d83129" acquired by "delete_volume" :: waited 0.043s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:10 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b8b8de-88ec-479c-8c29-4fd5c27a1a63]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:10 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 Sep 29 16:37:10 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:10 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129" returned: 0 in 0.648s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:10 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129 Sep 29 16:37:10 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:10 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-44bb1c0d-6ca4-4d39-9f6d-fa961415390e tempest-GroupSnapshotsTest-1461147352 None] Update group completed successfully. Sep 29 16:37:11 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-04403e55-f239-4a48-900b-35c297d83129" returned: 0 in 0.291s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Lock "cinder-quobyte-04403e55-f239-4a48-900b-35c297d83129" released by "delete_volume" :: held 1.038s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG cinder.quota [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Created reservations ['cce7a96f-c368-4fb4-bffe-e18d445de8ea', 'f69eb383-9649-436b-a865-629637303183', '0658e4fb-ca15-4e8d-ba5c-54ea5f25a217', '029e0f10-300b-4e79-80d8-eae7a822822e'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:11 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:37:11 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:11 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Acquiring lock "cinder-37c7b475-6b06-42c0-bee6-a62f56dabd80-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.334s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG cinder.manager [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:37:11 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Deleted volume successfully. Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Lock "cinder-37c7b475-6b06-42c0-bee6-a62f56dabd80-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-41718cc5-ed63-4cdb-9298-a79fa705613e req-ffdb2631-7b10-43ad-85a8-73824f37c847 tempest-ServerActionsTestOtherA-418642240 None] Lock "cinder-04403e55-f239-4a48-900b-35c297d83129-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Acquiring lock "cinder-quobyte-37c7b475-6b06-42c0-bee6-a62f56dabd80" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Lock "cinder-quobyte-37c7b475-6b06-42c0-bee6-a62f56dabd80" acquired by "delete_volume" :: waited 0.041s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5809362f-92f6-494d-b875-87f0542d5435]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-37c7b475-6b06-42c0-bee6-a62f56dabd80 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:12 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-37c7b475-6b06-42c0-bee6-a62f56dabd80 Sep 29 16:37:12 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:12 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e1d39ca0-570a-474f-a72c-44d174561031 tempest-GroupSnapshotsTest-1461147352 None] Update group completed successfully. Sep 29 16:37:12 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-37c7b475-6b06-42c0-bee6-a62f56dabd80" returned: 0 in 0.506s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-37c7b475-6b06-42c0-bee6-a62f56dabd80 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:12 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-37c7b475-6b06-42c0-bee6-a62f56dabd80 Sep 29 16:37:12 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:12 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-37c7b475-6b06-42c0-bee6-a62f56dabd80" returned: 0 in 0.323s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Lock "cinder-quobyte-37c7b475-6b06-42c0-bee6-a62f56dabd80" released by "delete_volume" :: held 0.949s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:12 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Created reservations ['0f437290-b08e-4d9a-b11d-4426e30dfc4b', 'a08fe957-d99f-4209-8c51-136a041c06e5', '21c5384f-6936-4b7f-bd97-0cbbcbb67cd7', 'f77d8cce-3c63-41a0-8012-5e8c7cace23a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:37:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:37:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:37:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:37:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:37:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:13 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:37:13 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:13 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.340s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:13 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:37:13 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Deleted volume successfully. Sep 29 16:37:13 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ec6f57ac-dd78-4eeb-a5ff-9c553eeb9f03 tempest-GroupSnapshotsTest-1461147352 None] Update group completed successfully. Sep 29 16:37:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3df5e604-b50a-4be3-890f-9beb6fbfdfa5 tempest-ServerActionsTestOtherA-418642240 None] Lock "cinder-37c7b475-6b06-42c0-bee6-a62f56dabd80-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:15 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] GroupSnapshot f201c1aa-2eca-41fd-993a-3355a5c0eeb4: creating. Sep 29 16:37:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Group snapshot f201c1aa-2eca-41fd-993a-3355a5c0eeb4: creating. {{(pid=86793) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 16:37:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:37:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Creating offline snapshot 4bea9127-ef5e-42d2-8bae-d64c527fdcec of volume 4f249cf5-3c20-409a-9bb3-1369b72893c9 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:37:15 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ce8cb6-26c9-48a2-992e-44918b533990]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:15 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 Sep 29 16:37:15 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:15 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9" returned: 0 in 0.466s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:15 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec 1G Sep 29 16:37:15 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:16 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec 1G" returned: 0 in 0.961s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:16 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec Sep 29 16:37:16 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:17 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec" returned: 0 in 0.593s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:17 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec is being set with open permissions: ugo+rw: NotImplementedError Sep 29 16:37:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:17 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec Sep 29 16:37:17 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:17 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec" returned: 0 in 0.468s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:17 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.info Sep 29 16:37:17 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:18 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.info" returned: 0 in 0.484s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:18 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 16:37:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:18 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.info Sep 29 16:37:18 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:18 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.info" returned: 0 in 0.397s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.541s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:37:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:37:18 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Creating offline snapshot 656e3eae-a111-4f15-8a8b-a938b7dc1042 of volume 9c02c8f1-f4ce-4400-a06c-311b032417f0 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:37:18 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5d0eeb-bbbe-4f8c-8dc4-7b1929634932]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:19 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 Sep 29 16:37:19 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:19 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0" returned: 0 in 0.913s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:19 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 1G Sep 29 16:37:19 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bdb3d4e8-ca7d-4676-b20c-506119d1b866 tempest-VolumesActionsTest-2117664832 None] Acquiring lock "cinder-cf915a89-d911-4a22-a455-456387af1b79" by "attach_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bdb3d4e8-ca7d-4676-b20c-506119d1b866 tempest-VolumesActionsTest-2117664832 None] Lock "cinder-cf915a89-d911-4a22-a455-456387af1b79" acquired by "attach_volume" :: waited 0.038s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:20 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-bdb3d4e8-ca7d-4676-b20c-506119d1b866 tempest-VolumesActionsTest-2117664832 None] Attaching volume cf915a89-d911-4a22-a455-456387af1b79 to instance 31ea17fd-0684-416e-a3f2-6b3df2082fd8 at mountpoint /dev/vdb on host None. Sep 29 16:37:20 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-bdb3d4e8-ca7d-4676-b20c-506119d1b866 tempest-VolumesActionsTest-2117664832 None] Attach volume completed successfully. Sep 29 16:37:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bdb3d4e8-ca7d-4676-b20c-506119d1b866 tempest-VolumesActionsTest-2117664832 None] Lock "cinder-cf915a89-d911-4a22-a455-456387af1b79" released by "attach_volume" :: held 0.172s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:20 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 1G" returned: 0 in 0.799s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:20 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 Sep 29 16:37:20 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:21 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042" returned: 0 in 0.767s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:21 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 16:37:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:21 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 Sep 29 16:37:21 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e5f061da-0d9a-4424-987d-226b0ce3efb1 tempest-VolumesActionsTest-2117664832 None] Acquiring lock "cinder-cf915a89-d911-4a22-a455-456387af1b79-detach_volume" by "detach_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e5f061da-0d9a-4424-987d-226b0ce3efb1 tempest-VolumesActionsTest-2117664832 None] Lock "cinder-cf915a89-d911-4a22-a455-456387af1b79-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:21 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e5f061da-0d9a-4424-987d-226b0ce3efb1 tempest-VolumesActionsTest-2117664832 None] Detaching volume cf915a89-d911-4a22-a455-456387af1b79 from instance 31ea17fd-0684-416e-a3f2-6b3df2082fd8. Sep 29 16:37:21 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e5f061da-0d9a-4424-987d-226b0ce3efb1 tempest-VolumesActionsTest-2117664832 None] Detach volume completed successfully. Sep 29 16:37:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e5f061da-0d9a-4424-987d-226b0ce3efb1 tempest-VolumesActionsTest-2117664832 None] Lock "cinder-cf915a89-d911-4a22-a455-456387af1b79-detach_volume" released by "detach_volume" :: held 0.122s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:21 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042" returned: 0 in 0.558s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:22 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.info Sep 29 16:37:22 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:22 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.info" returned: 0 in 0.487s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:22 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 16:37:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:22 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.info Sep 29 16:37:22 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:22 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.info" returned: 0 in 0.351s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.105s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:37:23 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-03aad1ab-cb2a-4ef4-b250-44243191751f tempest-GroupSnapshotsTest-1461147352 None] group_snapshot f201c1aa-2eca-41fd-993a-3355a5c0eeb4: created successfully Sep 29 16:37:24 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] group_snapshot f201c1aa-2eca-41fd-993a-3355a5c0eeb4: deleting Sep 29 16:37:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] group_snapshot f201c1aa-2eca-41fd-993a-3355a5c0eeb4: deleting {{(pid=86793) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 16:37:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-4f249cf5-3c20-409a-9bb3-1369b72893c9" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-4f249cf5-3c20-409a-9bb3-1369b72893c9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-4bea9127-ef5e-42d2-8bae-d64c527fdcec" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-4bea9127-ef5e-42d2-8bae-d64c527fdcec" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Deleting offline snapshot 4bea9127-ef5e-42d2-8bae-d64c527fdcec of volume 4f249cf5-3c20-409a-9bb3-1369b72893c9 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:37:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] snapshot_file for this snap is: volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:37:24 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[91da260c-f693-4f6d-a61f-0d2272089930]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:24 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec Sep 29 16:37:24 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:24 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec" returned: 0 in 0.429s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f249cf5-3c20-409a-9bb3-1369b72893c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:37:24 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbc403f-aa77-43b9-9536-445773bb515a]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:24 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 Sep 29 16:37:24 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:25 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9" returned: 0 in 0.384s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:25 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec Sep 29 16:37:25 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:25 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec" returned: 0 in 0.368s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:25 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec Sep 29 16:37:25 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:25 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9.4bea9127-ef5e-42d2-8bae-d64c527fdcec" returned: 0 in 0.347s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-4bea9127-ef5e-42d2-8bae-d64c527fdcec" released by "_delete_snapshot" :: held 1.719s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-4f249cf5-3c20-409a-9bb3-1369b72893c9" released by "delete_snapshot" :: held 1.761s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-9c02c8f1-f4ce-4400-a06c-311b032417f0" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-9c02c8f1-f4ce-4400-a06c-311b032417f0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-656e3eae-a111-4f15-8a8b-a938b7dc1042" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-656e3eae-a111-4f15-8a8b-a938b7dc1042" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Deleting offline snapshot 656e3eae-a111-4f15-8a8b-a938b7dc1042 of volume 9c02c8f1-f4ce-4400-a06c-311b032417f0 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:37:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] snapshot_file for this snap is: volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:37:26 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cad3d43-3bed-4736-afc4-698d66c7e0f2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:26 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 Sep 29 16:37:26 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:26 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042" returned: 0 in 0.430s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c02c8f1-f4ce-4400-a06c-311b032417f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:37:26 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5714dd-24f3-49e8-8d22-ec1ade211e12]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:26 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 Sep 29 16:37:26 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:27 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0" returned: 0 in 0.503s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:27 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 Sep 29 16:37:27 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:27 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042" returned: 0 in 0.664s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:27 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042 Sep 29 16:37:27 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:28 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0.656e3eae-a111-4f15-8a8b-a938b7dc1042" returned: 0 in 0.309s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-656e3eae-a111-4f15-8a8b-a938b7dc1042" released by "_delete_snapshot" :: held 2.060s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-9c02c8f1-f4ce-4400-a06c-311b032417f0" released by "delete_snapshot" :: held 2.090s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:28 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=132,cinder:UPDATE=114,cinder:DELETE=5,cinder:INSERT=26 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:37:28 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=128,cinder:UPDATE=107,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:37:28 devstack cinder-volume[86793]: WARNING cinder.quota [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-260249055 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-260249055, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:37:28 devstack cinder-volume[86793]: WARNING cinder.quota [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-260249055 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-260249055, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:37:28 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Created reservations ['1eb3c8fb-f395-47c4-90fb-a756de428dc2', '0490ec6f-0705-4415-9f61-dc55a3edd8f3', 'cd468aa6-9a0c-40f6-bff3-02f2407c8b9f', 'b0c56f57-e4bd-4e1e-91a0-5e6c06454638'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:37:28 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] Created reservations ['8dfbc8b0-6639-4126-993f-46fcdbf546f1', '1280e02e-3cb9-4741-8183-2c1cd32374cf', 'a4bce7dd-369f-4ce6-af00-ba1768979214', 'f5396d74-e2d1-4947-9844-465aa2e371b2'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:37:28 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-9b5b1150-af07-4dba-82d0-4911b2585484 tempest-GroupSnapshotsTest-1461147352 None] group_snapshot f201c1aa-2eca-41fd-993a-3355a5c0eeb4: deleted successfully Sep 29 16:37:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-4f249cf5-3c20-409a-9bb3-1369b72893c9" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-4f249cf5-3c20-409a-9bb3-1369b72893c9" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:29 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b30e45-a26f-44cb-b337-4453b77685e1]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:37:29 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[65308ec6-2d49-45c0-a5ad-e18d50e46e0f]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:29 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 Sep 29 16:37:29 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:29 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 Sep 29 16:37:29 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:30 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9" returned: 0 in 0.518s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:30 devstack sudo[95149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9 Sep 29 16:37:30 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:30 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79" returned: 0 in 0.523s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:30 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[999a0bf2-73db-4af7-9361-e4b8290e1374]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:30 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 Sep 29 16:37:30 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:30 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4f249cf5-3c20-409a-9bb3-1369b72893c9" returned: 0 in 0.338s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-4f249cf5-3c20-409a-9bb3-1369b72893c9" released by "delete_volume" :: held 0.970s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-9c02c8f1-f4ce-4400-a06c-311b032417f0" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:37:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-9c02c8f1-f4ce-4400-a06c-311b032417f0" acquired by "delete_volume" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:37:30 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3628c7c-99ee-434a-ad5f-04cd80d83cf3]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:30 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 Sep 29 16:37:30 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:30 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79" returned: 0 in 0.492s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.400c70e5-87bf-4805-94f6-52c316c1749434isru3x.img {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:30 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.400c70e5-87bf-4805-94f6-52c316c1749434isru3x.img Sep 29 16:37:30 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:31 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0" returned: 0 in 0.525s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:31 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0 Sep 29 16:37:31 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:31 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9c02c8f1-f4ce-4400-a06c-311b032417f0" returned: 0 in 0.626s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-9c02c8f1-f4ce-4400-a06c-311b032417f0" released by "delete_volume" :: held 1.255s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:37:31 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Created reservations ['395a058c-bf0e-4759-a20d-2df2de88c84b'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:37:31 devstack cinder-volume[86793]: WARNING cinder.quota [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-260249055 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-260249055, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:37:31 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Created reservations ['6eba4984-0cfa-44c6-967f-908cb288bbb6', '609bf566-4988-4f1f-bb8c-84200f09d203', '9e366c72-1861-49e7-b814-d7f03b967d79', '246e3bab-d27e-44fb-a3c6-bf9f321231e2'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:37:32 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Created reservations ['34af0b8c-f006-4279-96f9-4aa1614d2a69', 'fca0a01d-df64-427f-b974-6edd77ea4a7a', 'd5451517-d9e5-4261-b62f-f9fa57c6d3ec', '6cfee163-1b3b-416d-b4a1-eae181a9275a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:37:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:37:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:37:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:37:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:37:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:32 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:37:32 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:32 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.351s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:32 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:37:32 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3fa7d243-3983-478a-a370-213929910e7b tempest-GroupSnapshotsTest-1461147352 None] Delete group completed successfully. Sep 29 16:37:34 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-061060ac-fe50-415a-b1e8-9a015203af74 tempest-GroupSnapshotsTest-1461147352 None] Group tempest-GroupSnapshotsTest-Group-1875393020: creating Sep 29 16:37:34 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-061060ac-fe50-415a-b1e8-9a015203af74 tempest-GroupSnapshotsTest-1461147352 None] Group tempest-GroupSnapshotsTest-Group-1875393020: created successfully Sep 29 16:37:34 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-061060ac-fe50-415a-b1e8-9a015203af74 tempest-GroupSnapshotsTest-1461147352 None] Create group completed successfully. Sep 29 16:37:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:37:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:37:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:37:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:37:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:37:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:34 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:37:34 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:35 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.568s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:37:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:37:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:37:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:37:37 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:37:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Flow 'volume_create_manager' (47afbc21-272e-41d1-b8da-291159979dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:37:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a9a68f-8916-4ee9-8913-987d11a02a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0a9a68f-8916-4ee9-8913-987d11a02a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-465040055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=329e741b-9a87-470a-a947-107fb2d92e2b,host='devstack@QuobyteHD#QuobyteHD',id=d65dceea-4439-45fc-b0d6-7458387e4628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06abe217738b4d4a9bffadf62cc1d549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:37Z,use_quota=True,user_id='c6fe022ee07f4906b42ada2e4c4785b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51fb121a-56f3-4d30-a70f-99bacb0f595a),volume_type_id=51fb121a-56f3-4d30-a70f-99bacb0f595a)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055774e5-8c37-4a31-abfd-ea01663cea78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055774e5-8c37-4a31-abfd-ea01663cea78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1049b4-6862-465e-bc9d-8d6b94c8bc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1049b4-6862-465e-bc9d-8d6b94c8bc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65dceea-4439-45fc-b0d6-7458387e4628', 'volume_name': 'volume-d65dceea-4439-45fc-b0d6-7458387e4628', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b18d17-6648-4e20-8bce-bf0154b10566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b18d17-6648-4e20-8bce-bf0154b10566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:37:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a16cb2-4b65-4656-86cf-ce5e0dd4acc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:37:37 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Volume d65dceea-4439-45fc-b0d6-7458387e4628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65dceea-4439-45fc-b0d6-7458387e4628', 'volume_size': 1} Sep 29 16:37:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:37:39 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.400c70e5-87bf-4805-94f6-52c316c1749434isru3x.img" returned: 0 in 9.067s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:39 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ecdd2b-bfc7-4294-9351-c1b29883faef]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:37:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:37:39 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 Sep 29 16:37:39 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:37:40 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Sep 29 16:37:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79" returned: 0 in 0.578s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:37:40 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79, size 1024.00 MB, duration 9.07 sec, destination /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.400c70e5-87bf-4805-94f6-52c316c1749434isru3x.img {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:37:40 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] Converted 1024.00 MB image at 112.92 MB/s Sep 29 16:37:40 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] 400c70e5-87bf-4805-94f6-52c316c17494 was raw, no need to convert to raw {{(pid=86793) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 29 16:37:50 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=27,cinder:INSERT=9,cinder:UPDATE=30 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:37:50 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=26,cinder:INSERT=8,cinder:UPDATE=33 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:38:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 43.950s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] Uploaded volume to glance image-id: 400c70e5-87bf-4805-94f6-52c316c17494. {{(pid=86793) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 29 16:38:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 36.216s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=329e741b-9a87-470a-a947-107fb2d92e2b,created_at=2026-09-29T14:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-465040055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=329e741b-9a87-470a-a947-107fb2d92e2b,host='devstack@QuobyteHD#QuobyteHD',id=d65dceea-4439-45fc-b0d6-7458387e4628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06abe217738b4d4a9bffadf62cc1d549',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:37:37Z,use_quota=True,user_id='c6fe022ee07f4906b42ada2e4c4785b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51fb121a-56f3-4d30-a70f-99bacb0f595a),volume_type_id=51fb121a-56f3-4d30-a70f-99bacb0f595a)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:38:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Creating volume d65dceea-4439-45fc-b0d6-7458387e4628 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:38:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:38:13 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:38:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:13 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628 1073741824 Sep 29 16:38:13 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:13 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5796bfac-e17e-40a2-9965-63781e3781a6 tempest-VolumesActionsTest-2117664832 None] Copy volume to image completed successfully. Sep 29 16:38:14 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628 1073741824" returned: 0 in 0.758s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:14 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628 Sep 29 16:38:14 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:14 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628" returned: 0 in 0.261s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:38:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2a16cb2-4b65-4656-86cf-ce5e0dd4acc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65dceea-4439-45fc-b0d6-7458387e4628', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8eff315-df38-4894-af57-ac10e7696d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:14 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Volume volume-d65dceea-4439-45fc-b0d6-7458387e4628 (d65dceea-4439-45fc-b0d6-7458387e4628): created successfully Sep 29 16:38:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8eff315-df38-4894-af57-ac10e7696d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Flow 'volume_create_manager' (47afbc21-272e-41d1-b8da-291159979dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:14 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3d39cab1-8e05-4996-b9b3-ee9c72a5e715 tempest-GroupSnapshotsTest-1461147352 None] Created volume successfully. Sep 29 16:38:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:15 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f061809d-bd7e-4540-8ef9-ab683ca9c0bc]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:15 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 Sep 29 16:38:15 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:16 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79" returned: 0 in 0.523s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:16 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2c6df5-d493-4137-a0e2-a60082d921b2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:16 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 Sep 29 16:38:16 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:16 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] GroupSnapshot d5225c21-6033-4a6c-bcb8-cc69378a401b: creating. Sep 29 16:38:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] Group snapshot d5225c21-6033-4a6c-bcb8-cc69378a401b: creating. {{(pid=86793) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 16:38:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:16 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79" returned: 0 in 0.704s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:16 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img Sep 29 16:38:16 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Flow 'volume_create_manager' (29df8422-5c64-404c-9bff-763fcfc1be40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5407020-acdd-402e-892b-400da32e8bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Flow 'volume_create_manager' (55ced939-ffb1-4ee0-a7a8-41ab947e54f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f1bb52-912d-462e-bf67-96784f41021b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5407020-acdd-402e-892b-400da32e8bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1320396354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cacff5-25fd-4799-8420-a62684afee7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2deba2e18241a3bdb676abb80c43a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:22Z,use_quota=True,user_id='03816101e8bf4f10b80acfc80cba209e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3a2cc0-5e1c-4c68-bf99-74458082bad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3a2cc0-5e1c-4c68-bf99-74458082bad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84d85d2-98b4-4edf-91d2-0496e8253d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84d85d2-98b4-4edf-91d2-0496e8253d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45cacff5-25fd-4799-8420-a62684afee7a', 'volume_name': 'volume-45cacff5-25fd-4799-8420-a62684afee7a', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913097ed-5e20-4b17-a57d-16f0a86a143e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913097ed-5e20-4b17-a57d-16f0a86a143e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a604bf-a9ab-4e1f-9b49-fa9231e8e5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:22 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Volume 45cacff5-25fd-4799-8420-a62684afee7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45cacff5-25fd-4799-8420-a62684afee7a', 'volume_size': 1} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f1bb52-912d-462e-bf67-96784f41021b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-87975735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6f8d0e-10f3-4c5c-b267-116c3253173d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d786a83201d1442c9e75f73b3820b78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:22Z,use_quota=True,user_id='871b5c15788e48a3962da7a471aff71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed96bf95-2cab-40e2-86f4-32dfcbe0335e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed96bf95-2cab-40e2-86f4-32dfcbe0335e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e42cbbe-1186-447e-b117-f8e2029e718b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e42cbbe-1186-447e-b117-f8e2029e718b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec6f8d0e-10f3-4c5c-b267-116c3253173d', 'volume_name': 'volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35bcf02-31e0-47c1-806d-97571944d4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35bcf02-31e0-47c1-806d-97571944d4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d024ac-0ac0-4151-b776-2756b955de35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:22 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Volume ec6f8d0e-10f3-4c5c-b267-116c3253173d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d', 'volume_size': 1} Sep 29 16:38:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:25 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img" returned: 0 in 8.344s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:25 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b793e6e-f08e-4864-bc16-671e68efa743]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:25 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 Sep 29 16:38:25 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:25 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79" returned: 0 in 0.546s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:25 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79, size 1024.00 MB, duration 8.34 sec, destination /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:38:25 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Converted 1024.00 MB image at 122.71 MB/s Sep 29 16:38:25 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] 009b631f-6a2c-466f-b8cc-45bec0f97974 was raw, converting to qcow2 {{(pid=86793) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 29 16:38:25 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be50bae-0469-43f8-938d-a29cfbc26e5b]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:25 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img Sep 29 16:38:25 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:26 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img" returned: 0 in 0.335s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:26 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img Sep 29 16:38:26 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:26 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img" returned: 1 in 0.335s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:38:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img /opt/stack/data/cinder/conversion/vol_upload_42c254fi {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:26 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img /opt/stack/data/cinder/conversion/vol_upload_42c254fi Sep 29 16:38:26 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:26 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img /opt/stack/data/cinder/conversion/vol_upload_42c254fi" returned: 0 in 0.253s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:26 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Image conversion details: src /opt/stack/data/cinder/conversion/cf915a89-d911-4a22-a455-456387af1b79.temp_image.009b631f-6a2c-466f-b8cc-45bec0f97974vlp11sjs.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_42c254fi {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:38:26 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 29 16:38:26 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d7b37f-c0d8-4ef2-87f6-f25e97c17cfb]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_42c254fi {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:26 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_42c254fi Sep 29 16:38:26 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:27 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_42c254fi" returned: 0 in 0.317s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.779s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Uploaded volume to glance image-id: 009b631f-6a2c-466f-b8cc-45bec0f97974. {{(pid=86793) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 29 16:38:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.862s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] Creating offline snapshot d8dec678-c246-47bf-af87-0da7bb041d6c of volume d65dceea-4439-45fc-b0d6-7458387e4628 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:38:28 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a329368a-f0da-47fd-9b39-eb6dd3fd91f0 tempest-VolumesActionsTest-2117664832 None] Copy volume to image completed successfully. Sep 29 16:38:28 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0c6392-2c01-4630-b42a-ff396a7e2998]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:28 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628 Sep 29 16:38:28 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:28 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628" returned: 0 in 0.386s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:28 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c 1G Sep 29 16:38:28 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:29 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c 1G" returned: 0 in 0.418s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d65dceea-4439-45fc-b0d6-7458387e4628 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:29 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d65dceea-4439-45fc-b0d6-7458387e4628 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c Sep 29 16:38:29 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:29 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d65dceea-4439-45fc-b0d6-7458387e4628 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c" returned: 0 in 0.321s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:29 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c is being set with open permissions: ugo+rw: NotImplementedError Sep 29 16:38:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:29 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c Sep 29 16:38:29 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:29 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c" returned: 0 in 0.240s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:29 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.info Sep 29 16:38:29 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Acquiring lock "cinder-cf915a89-d911-4a22-a455-456387af1b79-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Lock "cinder-cf915a89-d911-4a22-a455-456387af1b79-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Acquiring lock "cinder-quobyte-cf915a89-d911-4a22-a455-456387af1b79" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Lock "cinder-quobyte-cf915a89-d911-4a22-a455-456387af1b79" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:38:30 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.info" returned: 0 in 0.307s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:30 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd33d10-377d-4807-a162-faa9028cf33e]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:30 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.info Sep 29 16:38:30 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:30 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 Sep 29 16:38:30 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:30 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.info" returned: 0 in 0.257s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.691s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1320396354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cacff5-25fd-4799-8420-a62684afee7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2deba2e18241a3bdb676abb80c43a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:22Z,use_quota=True,user_id='03816101e8bf4f10b80acfc80cba209e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Creating volume 45cacff5-25fd-4799-8420-a62684afee7a {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:38:30 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-45cacff5-25fd-4799-8420-a62684afee7a 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:30 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-45cacff5-25fd-4799-8420-a62684afee7a 1073741824 Sep 29 16:38:30 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:30 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2a11e866-cae4-47ec-8b09-7bce1ce1fe83 tempest-GroupSnapshotsTest-1461147352 None] group_snapshot d5225c21-6033-4a6c-bcb8-cc69378a401b: created successfully Sep 29 16:38:30 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79" returned: 0 in 0.411s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:30 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79 Sep 29 16:38:30 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:30 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cf915a89-d911-4a22-a455-456387af1b79" returned: 0 in 0.292s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Lock "cinder-quobyte-cf915a89-d911-4a22-a455-456387af1b79" released by "delete_volume" :: held 0.755s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:38:30 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Created reservations ['508c6047-1c0b-4627-8f6d-b23d5400b487', '6c4595c1-a73b-47ad-b5bb-d1a4260931de', '1764ed42-1925-4aae-aff8-3f30f301a1a9', '9478ae8f-20f7-4324-a7d9-06915f9d5997'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-45cacff5-25fd-4799-8420-a62684afee7a 1073741824" returned: 0 in 0.516s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-45cacff5-25fd-4799-8420-a62684afee7a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:31 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] group_snapshot d5225c21-6033-4a6c-bcb8-cc69378a401b: deleting Sep 29 16:38:31 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-45cacff5-25fd-4799-8420-a62684afee7a Sep 29 16:38:31 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] group_snapshot d5225c21-6033-4a6c-bcb8-cc69378a401b: deleting {{(pid=86793) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-d65dceea-4439-45fc-b0d6-7458387e4628" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:38:31 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:38:31 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-d65dceea-4439-45fc-b0d6-7458387e4628" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-d8dec678-c246-47bf-af87-0da7bb041d6c" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-d8dec678-c246-47bf-af87-0da7bb041d6c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Deleting offline snapshot d8dec678-c246-47bf-af87-0da7bb041d6c of volume d65dceea-4439-45fc-b0d6-7458387e4628 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] snapshot_file for this snap is: volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ea136c-8fb5-48ae-b78c-cae7cff00a92]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:31 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.320s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:31 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-45cacff5-25fd-4799-8420-a62684afee7a" returned: 0 in 0.424s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.612s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:31 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-87975735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec6f8d0e-10f3-4c5c-b267-116c3253173d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d786a83201d1442c9e75f73b3820b78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:22Z,use_quota=True,user_id='871b5c15788e48a3962da7a471aff71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Creating volume ec6f8d0e-10f3-4c5c-b267-116c3253173d {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:31 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:38:31 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:31 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Deleted volume successfully. Sep 29 16:38:31 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d 1073741824 Sep 29 16:38:31 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0a604bf-a9ab-4e1f-9b49-fa9231e8e5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45cacff5-25fd-4799-8420-a62684afee7a', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953608d7-0633-421c-900a-fae53ea960e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b37fae64-c11c-4a79-ae3d-4c513d2890ce tempest-VolumesActionsTest-2117664832 None] Lock "cinder-cf915a89-d911-4a22-a455-456387af1b79-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:38:31 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Volume volume-45cacff5-25fd-4799-8420-a62684afee7a (45cacff5-25fd-4799-8420-a62684afee7a): created successfully Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953608d7-0633-421c-900a-fae53ea960e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Flow 'volume_create_manager' (29df8422-5c64-404c-9bff-763fcfc1be40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:31 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-8fc3f8bf-7997-4c4c-8417-06aba09a63a2 tempest-ServersNegativeTestJSON-154623338 None] Created volume successfully. Sep 29 16:38:31 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c" returned: 0 in 0.519s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d65dceea-4439-45fc-b0d6-7458387e4628(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[40035d46-5438-41de-9bdf-8fb998bcca97]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:31 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628 Sep 29 16:38:31 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:31 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d 1073741824" returned: 0 in 0.508s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:32 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d Sep 29 16:38:32 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:32 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628" returned: 0 in 0.468s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:32 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c Sep 29 16:38:32 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:32 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d" returned: 0 in 0.310s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:38:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71d024ac-0ac0-4151-b776-2756b955de35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40aab44-8ee1-4de1-a8f2-b86087fc2c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:32 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Volume volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d (ec6f8d0e-10f3-4c5c-b267-116c3253173d): created successfully Sep 29 16:38:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40aab44-8ee1-4de1-a8f2-b86087fc2c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Flow 'volume_create_manager' (55ced939-ffb1-4ee0-a7a8-41ab947e54f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:32 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-6360e1be-43ea-4df5-918d-d4d3bb41030f tempest-AttachVolumeNegativeTest-2009311936 None] Created volume successfully. Sep 29 16:38:32 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c" returned: 0 in 0.470s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:32 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c Sep 29 16:38:32 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:33 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628.d8dec678-c246-47bf-af87-0da7bb041d6c" returned: 0 in 0.385s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-d8dec678-c246-47bf-af87-0da7bb041d6c" released by "_delete_snapshot" :: held 2.016s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:38:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-d65dceea-4439-45fc-b0d6-7458387e4628" released by "delete_snapshot" :: held 2.055s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:38:33 devstack cinder-volume[86793]: WARNING cinder.quota [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-784109896 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-784109896, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:38:33 devstack cinder-volume[86793]: WARNING cinder.quota [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-784109896 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-784109896, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:38:33 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] Created reservations ['0ba26fe7-a2ac-40a8-8271-da5ec3f35c9e', '840deb58-3b7d-4472-9a37-426d331b6482', 'ca8da782-1efe-4afd-b4d9-f7c5f82c62f9', '8f93eb19-cba8-486a-8b03-63617b00d5d6'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:38:33 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-86bfa5f6-8f5a-42b9-82cb-7df5e1dd8fc7 tempest-GroupSnapshotsTest-1461147352 None] group_snapshot d5225c21-6033-4a6c-bcb8-cc69378a401b: deleted successfully Sep 29 16:38:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-e279f088-5d67-42f8-9c49-ecde1ee7b503 req-7d1d85d3-d800-4b14-aacc-741827b61154 tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-e279f088-5d67-42f8-9c49-ecde1ee7b503 req-7d1d85d3-d800-4b14-aacc-741827b61154 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-e279f088-5d67-42f8-9c49-ecde1ee7b503 req-7d1d85d3-d800-4b14-aacc-741827b61154 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-e279f088-5d67-42f8-9c49-ecde1ee7b503 req-7d1d85d3-d800-4b14-aacc-741827b61154 tempest-AttachVolumeNegativeTest-2009311936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f61df00-e178-4c3b-b720-7b99a660f458', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:38:33 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-e279f088-5d67-42f8-9c49-ecde1ee7b503 req-7d1d85d3-d800-4b14-aacc-741827b61154 tempest-AttachVolumeNegativeTest-2009311936 None] attachment_update completed successfully. Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Flow 'volume_create_manager' (51a921ea-813c-411e-bd02-6ab4ccdfdab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82333a7e-9322-4d54-b61a-ce3078adc987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82333a7e-9322-4d54-b61a-ce3078adc987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-300567156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ec8985-4635-4b3f-8a52-f957b5ed9397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2deba2e18241a3bdb676abb80c43a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:34Z,use_quota=True,user_id='03816101e8bf4f10b80acfc80cba209e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b409dbbf-3210-4992-938c-d12fa51f94ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b409dbbf-3210-4992-938c-d12fa51f94ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3f2f50-3428-4cc8-969a-ddd6a36459e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3f2f50-3428-4cc8-969a-ddd6a36459e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ec8985-4635-4b3f-8a52-f957b5ed9397', 'volume_name': 'volume-67ec8985-4635-4b3f-8a52-f957b5ed9397', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b091c0-7d93-49cd-bf47-cc39a9f222de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b091c0-7d93-49cd-bf47-cc39a9f222de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c82236d-7631-427b-8294-6c08eeb18623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:34 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Volume 67ec8985-4635-4b3f-8a52-f957b5ed9397: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ec8985-4635-4b3f-8a52-f957b5ed9397', 'volume_size': 1} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-300567156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ec8985-4635-4b3f-8a52-f957b5ed9397,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b2deba2e18241a3bdb676abb80c43a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:34Z,use_quota=True,user_id='03816101e8bf4f10b80acfc80cba209e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Creating volume 67ec8985-4635-4b3f-8a52-f957b5ed9397 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:38:34 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-67ec8985-4635-4b3f-8a52-f957b5ed9397 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "cinder-quobyte-d65dceea-4439-45fc-b0d6-7458387e4628" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:38:34 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-67ec8985-4635-4b3f-8a52-f957b5ed9397 1073741824 Sep 29 16:38:34 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-d65dceea-4439-45fc-b0d6-7458387e4628" acquired by "delete_volume" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2288f8-b892-44b3-b502-63ed982b430a]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:34 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628 Sep 29 16:38:34 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:34 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:38:34 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:34 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628" returned: 0 in 0.470s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:34 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-67ec8985-4635-4b3f-8a52-f957b5ed9397 1073741824" returned: 0 in 0.606s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:34 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628 Sep 29 16:38:34 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-67ec8985-4635-4b3f-8a52-f957b5ed9397 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:34 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-67ec8985-4635-4b3f-8a52-f957b5ed9397 Sep 29 16:38:34 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:35 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.333s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:38:35 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d65dceea-4439-45fc-b0d6-7458387e4628" returned: 0 in 0.309s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Lock "cinder-quobyte-d65dceea-4439-45fc-b0d6-7458387e4628" released by "delete_volume" :: held 0.872s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:38:35 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-67ec8985-4635-4b3f-8a52-f957b5ed9397" returned: 0 in 0.328s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c82236d-7631-427b-8294-6c08eeb18623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ec8985-4635-4b3f-8a52-f957b5ed9397', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40befcc7-fc7f-4442-a166-ed86f39a1d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:35 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Volume volume-67ec8985-4635-4b3f-8a52-f957b5ed9397 (67ec8985-4635-4b3f-8a52-f957b5ed9397): created successfully Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40befcc7-fc7f-4442-a166-ed86f39a1d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Flow 'volume_create_manager' (51a921ea-813c-411e-bd02-6ab4ccdfdab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Created reservations ['c2c93c57-618d-46d7-b495-0182e93d8e30'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:38:35 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e8b13c22-059b-4b35-aa0b-dd932f341dce tempest-ServersNegativeTestJSON-154623338 None] Created volume successfully. Sep 29 16:38:35 devstack cinder-volume[86793]: WARNING cinder.quota [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-784109896 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-784109896, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Created reservations ['be4bfdc7-e50d-47d9-8d10-9f64b8323993', '48ab91f7-d862-43b7-a0f2-4c7af6dc6e56', '52cadeef-7ebe-4ea4-beb3-335005e9a66d', 'f7df6e9a-cb4b-4cdb-acb7-cc7b74ca8bc1'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:35 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:38:35 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:35 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.281s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:38:35 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-6604d719-b6c6-4b08-a5b6-fc21c5067467 tempest-GroupSnapshotsTest-1461147352 None] Delete group completed successfully. Sep 29 16:38:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Acquiring lock "cinder-67ec8985-4635-4b3f-8a52-f957b5ed9397-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:38:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Lock "cinder-67ec8985-4635-4b3f-8a52-f957b5ed9397-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:38:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Acquiring lock "cinder-quobyte-67ec8985-4635-4b3f-8a52-f957b5ed9397" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:38:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Lock "cinder-quobyte-67ec8985-4635-4b3f-8a52-f957b5ed9397" acquired by "delete_volume" :: waited 0.031s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:38:36 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d5a9b4-e214-4ede-a320-8592231130ae]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-67ec8985-4635-4b3f-8a52-f957b5ed9397 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:37 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-67ec8985-4635-4b3f-8a52-f957b5ed9397 Sep 29 16:38:37 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:37 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-67ec8985-4635-4b3f-8a52-f957b5ed9397" returned: 0 in 0.481s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-67ec8985-4635-4b3f-8a52-f957b5ed9397 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:37 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-67ec8985-4635-4b3f-8a52-f957b5ed9397 Sep 29 16:38:37 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:37 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-67ec8985-4635-4b3f-8a52-f957b5ed9397" returned: 0 in 0.301s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:37 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Lock "cinder-quobyte-67ec8985-4635-4b3f-8a52-f957b5ed9397" released by "delete_volume" :: held 0.833s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:38:37 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Created reservations ['6014c3bc-6bee-4733-b906-65d7e09ffc71', 'b14c8343-0e21-43ba-a2f5-0123c3592d8d', 'eab1bbb7-00cc-483f-ac73-8588bdc4fc05', '3efa5a63-7e45-41ee-9b80-ac0c7da5f9c3'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:38:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:38 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:38:38 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:38 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Acquiring lock "cinder-45cacff5-25fd-4799-8420-a62684afee7a-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:38:38 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Lock "cinder-45cacff5-25fd-4799-8420-a62684afee7a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:38:38 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Acquiring lock "cinder-quobyte-45cacff5-25fd-4799-8420-a62684afee7a" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:38:38 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Lock "cinder-quobyte-45cacff5-25fd-4799-8420-a62684afee7a" acquired by "delete_volume" :: waited 0.031s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:38:38 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[006aef38-6da3-4a89-9b48-832840341488]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-45cacff5-25fd-4799-8420-a62684afee7a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:38 devstack sudo[96243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-45cacff5-25fd-4799-8420-a62684afee7a Sep 29 16:38:38 devstack sudo[96243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:38 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.449s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:38 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:38:38 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Deleted volume successfully. Sep 29 16:38:38 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ef5d961f-7515-41bc-9b79-b6abaab1d687 tempest-ServersNegativeTestJSON-154623338 None] Lock "cinder-67ec8985-4635-4b3f-8a52-f957b5ed9397-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:38:38 devstack sudo[96243]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-45cacff5-25fd-4799-8420-a62684afee7a" returned: 0 in 0.483s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-45cacff5-25fd-4799-8420-a62684afee7a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:38 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-45cacff5-25fd-4799-8420-a62684afee7a Sep 29 16:38:38 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:39 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-45cacff5-25fd-4799-8420-a62684afee7a" returned: 0 in 0.309s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:39 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Lock "cinder-quobyte-45cacff5-25fd-4799-8420-a62684afee7a" released by "delete_volume" :: held 0.870s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:38:39 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Created reservations ['46b1a69a-8eff-4f6d-a9fe-8061b4464dd2', '23fefe80-adfc-4c14-b8d9-f5872ebedf78', 'fcd4e67b-bb4d-4efe-8c1c-15d89a145132', 'ce3462ae-ba91-4d30-b617-4a8bc68d56c8'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:38:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:39 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:38:39 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:39 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.345s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:39 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:38:39 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Deleted volume successfully. Sep 29 16:38:39 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-48857b91-92b8-4169-be47-8b31c69a2cd3 tempest-ServersNegativeTestJSON-154623338 None] Lock "cinder-45cacff5-25fd-4799-8420-a62684afee7a-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Flow 'volume_create_manager' (712462c2-0edd-40e1-bb0f-66ab341bf855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c0b6af8-c9ca-408f-b504-058b4bfca2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c0b6af8-c9ca-408f-b504-058b4bfca2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-285002971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e079aef-7bf3-43b5-bc0c-0bff0496871e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec4d0b5e92f4ed497d03a97a7358a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:41Z,use_quota=True,user_id='075f6b42b8274f3793561d327368103c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c124cff-50bc-4b20-aaaf-5b5555edc49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c124cff-50bc-4b20-aaaf-5b5555edc49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54d8e96-32e6-4752-a4a7-23dd5d620a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54d8e96-32e6-4752-a4a7-23dd5d620a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e079aef-7bf3-43b5-bc0c-0bff0496871e', 'volume_name': 'volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e', 'volume_size': 2}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07347b1-eb7f-4c84-badc-6882a75a33ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07347b1-eb7f-4c84-badc-6882a75a33ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6ab385-29f5-4867-bd63-1727bc351c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:41 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Volume 8e079aef-7bf3-43b5-bc0c-0bff0496871e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e', 'volume_size': 2} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-285002971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e079aef-7bf3-43b5-bc0c-0bff0496871e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ec4d0b5e92f4ed497d03a97a7358a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:41Z,use_quota=True,user_id='075f6b42b8274f3793561d327368103c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Creating volume 8e079aef-7bf3-43b5-bc0c-0bff0496871e {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:38:41 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:38:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e 2147483648 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:41 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e 2147483648 Sep 29 16:38:41 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:42 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e 2147483648" returned: 0 in 1.011s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:42 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e Sep 29 16:38:42 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:42 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e" returned: 0 in 0.438s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:38:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6ab385-29f5-4867-bd63-1727bc351c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e', 'volume_size': 2}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475d4678-e503-47db-a81d-0968aa20c527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:42 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Volume volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e (8e079aef-7bf3-43b5-bc0c-0bff0496871e): created successfully Sep 29 16:38:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (475d4678-e503-47db-a81d-0968aa20c527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Flow 'volume_create_manager' (712462c2-0edd-40e1-bb0f-66ab341bf855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:42 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2f9a5f25-834f-4a79-8fb3-e094fdb50974 tempest-VolumesCloneNegativeTest-1089376690 None] Created volume successfully. Sep 29 16:38:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Acquiring lock "cinder-8e079aef-7bf3-43b5-bc0c-0bff0496871e-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:38:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Lock "cinder-8e079aef-7bf3-43b5-bc0c-0bff0496871e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:38:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Acquiring lock "cinder-quobyte-8e079aef-7bf3-43b5-bc0c-0bff0496871e" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:38:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Lock "cinder-quobyte-8e079aef-7bf3-43b5-bc0c-0bff0496871e" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:38:43 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[52af859d-6e31-4928-8959-6f25b0892597]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:43 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e Sep 29 16:38:43 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:44 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e" returned: 0 in 0.606s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:44 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e Sep 29 16:38:44 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:44 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e079aef-7bf3-43b5-bc0c-0bff0496871e" returned: 0 in 0.466s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Lock "cinder-quobyte-8e079aef-7bf3-43b5-bc0c-0bff0496871e" released by "delete_volume" :: held 1.160s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:38:44 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Created reservations ['1ab52ba3-b61b-401e-a03b-831fba79e75b', '86cd3a4e-e025-4349-afb3-7a6ba4953ba4', '3c179580-bdc6-499f-9eb7-f1cfd0348f18', 'c86e2337-fa99-4a64-8078-1c36fd90fa4c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:38:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:45 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:38:45 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:45 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.331s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:45 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:38:45 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Deleted volume successfully. Sep 29 16:38:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cc4584d6-0096-4409-9293-ff8880e4bf40 tempest-VolumesCloneNegativeTest-1089376690 None] Lock "cinder-8e079aef-7bf3-43b5-bc0c-0bff0496871e-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:38:47 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-39aec423-95dd-4664-bba2-62f270ecadee tempest-GroupSnapshotsV319Test-791042284 None] Group tempest-GroupSnapshotsV319Test-Group-275512086: creating Sep 29 16:38:47 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-39aec423-95dd-4664-bba2-62f270ecadee tempest-GroupSnapshotsV319Test-791042284 None] Group tempest-GroupSnapshotsV319Test-Group-275512086: created successfully Sep 29 16:38:48 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-39aec423-95dd-4664-bba2-62f270ecadee tempest-GroupSnapshotsV319Test-791042284 None] Create group completed successfully. Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Flow 'volume_create_manager' (eb26e656-3ef9-42ae-968e-1810d7c5e213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84cdbc5-8b5c-435e-9ce1-4ff6ddaeb87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84cdbc5-8b5c-435e-9ce1-4ff6ddaeb87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1070490947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=436aa650-31a0-4f0d-ae55-7e3008ea9071,host='devstack@QuobyteHD#QuobyteHD',id=8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2043343fbad4bd1b0a6b8ae6e333870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:50Z,use_quota=True,user_id='b86b64fa94394d509de26dd4bc749fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b77c9e9-0ef6-49da-a468-3ae034eb44db),volume_type_id=6b77c9e9-0ef6-49da-a468-3ae034eb44db)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e455c08-921b-4a79-82ed-f74934339303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e455c08-921b-4a79-82ed-f74934339303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48297f7b-e8c8-40f7-ab80-398575947200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48297f7b-e8c8-40f7-ab80-398575947200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0', 'volume_name': 'volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5745bb8f-4908-4d89-baf6-3d4f1b368ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5745bb8f-4908-4d89-baf6-3d4f1b368ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78486246-d5b8-4816-8774-e756732f9710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:50 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Volume 8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0', 'volume_size': 1} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=436aa650-31a0-4f0d-ae55-7e3008ea9071,created_at=2026-09-29T14:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1070490947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=436aa650-31a0-4f0d-ae55-7e3008ea9071,host='devstack@QuobyteHD#QuobyteHD',id=8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2043343fbad4bd1b0a6b8ae6e333870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:50Z,use_quota=True,user_id='b86b64fa94394d509de26dd4bc749fca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b77c9e9-0ef6-49da-a468-3ae034eb44db),volume_type_id=6b77c9e9-0ef6-49da-a468-3ae034eb44db)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Creating volume 8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:38:50 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:38:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:50 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 1073741824 Sep 29 16:38:50 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:51 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 1073741824" returned: 0 in 0.669s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:51 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 Sep 29 16:38:51 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:51 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0" returned: 0 in 0.602s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:38:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78486246-d5b8-4816-8774-e756732f9710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6a8de8-328c-42d5-bc6e-0842e1cf0f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:51 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Volume volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 (8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0): created successfully Sep 29 16:38:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6a8de8-328c-42d5-bc6e-0842e1cf0f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Flow 'volume_create_manager' (eb26e656-3ef9-42ae-968e-1810d7c5e213) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:51 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3a7a5d64-7a8d-4175-800f-7dd7c97f24b5 tempest-GroupSnapshotsV319Test-791042284 None] Created volume successfully. Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Flow 'volume_create_manager' (6865e579-5849-4f88-946d-d3b8bf2cbce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b0736f-144b-469b-a6b5-808c2b9c642c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0b0736f-144b-469b-a6b5-808c2b9c642c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-929597907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf218e4-4770-499a-8601-6f6817004fa6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b6fa646c392417a8bf7e0617d70b324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:53Z,use_quota=True,user_id='00b87d8619984c34ae0508fce4d77a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881b18b2-9ec2-4705-b4ab-46548c4f7142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881b18b2-9ec2-4705-b4ab-46548c4f7142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4ff563-dbd7-49ba-98bf-5243960e9a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4ff563-dbd7-49ba-98bf-5243960e9a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf218e4-4770-499a-8601-6f6817004fa6', 'volume_name': 'volume-dbf218e4-4770-499a-8601-6f6817004fa6', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340107e4-8e6d-449c-925c-29911b3e0845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (340107e4-8e6d-449c-925c-29911b3e0845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af3b670-011f-4e52-8fa5-0849f08e8fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:52 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Volume dbf218e4-4770-499a-8601-6f6817004fa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf218e4-4770-499a-8601-6f6817004fa6', 'volume_size': 1} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-929597907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf218e4-4770-499a-8601-6f6817004fa6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b6fa646c392417a8bf7e0617d70b324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:53Z,use_quota=True,user_id='00b87d8619984c34ae0508fce4d77a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Creating volume dbf218e4-4770-499a-8601-6f6817004fa6 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:38:52 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:38:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dbf218e4-4770-499a-8601-6f6817004fa6 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:52 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dbf218e4-4770-499a-8601-6f6817004fa6 1073741824 Sep 29 16:38:52 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:53 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] GroupSnapshot 3feccb94-409f-4d4a-8026-e10f0d2332cf: creating. Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] Group snapshot 3feccb94-409f-4d4a-8026-e10f0d2332cf: creating. {{(pid=86793) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:53 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dbf218e4-4770-499a-8601-6f6817004fa6 1073741824" returned: 0 in 0.698s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dbf218e4-4770-499a-8601-6f6817004fa6 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:53 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dbf218e4-4770-499a-8601-6f6817004fa6 Sep 29 16:38:53 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:53 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dbf218e4-4770-499a-8601-6f6817004fa6" returned: 0 in 0.280s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.444s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af3b670-011f-4e52-8fa5-0849f08e8fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf218e4-4770-499a-8601-6f6817004fa6', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ed3470-7e5f-4975-82e4-266882c25678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] Creating offline snapshot 511ca823-f030-4598-96d1-d7fd8f75aa31 of volume 8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:38:53 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Volume volume-dbf218e4-4770-499a-8601-6f6817004fa6 (dbf218e4-4770-499a-8601-6f6817004fa6): created successfully Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ed3470-7e5f-4975-82e4-266882c25678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Flow 'volume_create_manager' (6865e579-5849-4f88-946d-d3b8bf2cbce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[24971d49-90a5-4500-9ee1-91e3312b02d3]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:53 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-37777619-9184-4ee4-a9f8-84769ca559f6 tempest-VolumesListTestJSON-516547032 None] Created volume successfully. Sep 29 16:38:53 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 Sep 29 16:38:53 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:54 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0" returned: 0 in 0.458s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:54 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 1G Sep 29 16:38:54 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:54 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 1G" returned: 0 in 0.502s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:54 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 Sep 29 16:38:54 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:55 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31" returned: 0 in 0.457s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:55 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:55 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 Sep 29 16:38:55 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Flow 'volume_create_manager' (004b0149-835d-46da-99cd-5e152f3374e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4318ae4-2af3-49e3-be8b-4c62ac0d07ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4318ae4-2af3-49e3-be8b-4c62ac0d07ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-134567186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b6fa646c392417a8bf7e0617d70b324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:55Z,use_quota=True,user_id='00b87d8619984c34ae0508fce4d77a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d42c47-9fec-4354-997c-f3129ed3f562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d42c47-9fec-4354-997c-f3129ed3f562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747246e8-15d3-4211-8649-573dff19454f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (747246e8-15d3-4211-8649-573dff19454f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf', 'volume_name': 'volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f36c20-a790-4aa2-990d-c5fde0ba5e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f36c20-a790-4aa2-990d-c5fde0ba5e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ada1347-8385-4a0d-8aae-6cd0456caa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:55 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Volume 59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf', 'volume_size': 1} Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:55 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31" returned: 0 in 0.318s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:55 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.info Sep 29 16:38:55 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:55 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.info" returned: 0 in 0.272s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:55 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 16:38:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:55 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.info Sep 29 16:38:55 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:56 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.info" returned: 0 in 0.261s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.407s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-134567186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b6fa646c392417a8bf7e0617d70b324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:55Z,use_quota=True,user_id='00b87d8619984c34ae0508fce4d77a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:38:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Creating volume 59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:38:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:38:56 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:38:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:56 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf 1073741824 Sep 29 16:38:56 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:56 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4e9341fb-f24d-4bc9-807e-31ceda88e902 tempest-GroupSnapshotsV319Test-791042284 None] group_snapshot 3feccb94-409f-4d4a-8026-e10f0d2332cf: created successfully Sep 29 16:38:56 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf 1073741824" returned: 0 in 0.596s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:56 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf Sep 29 16:38:56 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] group_snapshot 3feccb94-409f-4d4a-8026-e10f0d2332cf: deleting Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] group_snapshot 3feccb94-409f-4d4a-8026-e10f0d2332cf: deleting {{(pid=86793) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 16:38:57 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf" returned: 0 in 0.387s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Acquiring lock "cinder-quobyte-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Lock "cinder-quobyte-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Acquiring lock "cinder-quobyte-511ca823-f030-4598-96d1-d7fd8f75aa31" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ada1347-8385-4a0d-8aae-6cd0456caa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e159b95-3eb0-410e-9db0-8fdff549635c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:57 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Volume volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf (59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf): created successfully Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e159b95-3eb0-410e-9db0-8fdff549635c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Flow 'volume_create_manager' (004b0149-835d-46da-99cd-5e152f3374e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Lock "cinder-quobyte-511ca823-f030-4598-96d1-d7fd8f75aa31" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Deleting offline snapshot 511ca823-f030-4598-96d1-d7fd8f75aa31 of volume 8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] snapshot_file for this snap is: volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ce9b19-5a1b-4c41-b069-4e127722af11]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ffcfaf2d-ea1f-4c9f-8027-db4e24e0d131 tempest-VolumesListTestJSON-516547032 None] Created volume successfully. Sep 29 16:38:57 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 Sep 29 16:38:57 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:57 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31" returned: 0 in 0.490s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1047a2d4-c53a-4706-9aad-70ab2d8ce5cc]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:38:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:58 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 Sep 29 16:38:58 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:38:58 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Flow 'volume_create_manager' (15a82253-cbac-438b-aa81-074ca6677a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8719c722-5dec-4b80-bdf6-c692b1edcacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0" returned: 0 in 0.551s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:58 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 Sep 29 16:38:58 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8719c722-5dec-4b80-bdf6-c692b1edcacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1883193470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5c699d-06e8-4fc5-9897-9c430daecb2b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b6fa646c392417a8bf7e0617d70b324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:58Z,use_quota=True,user_id='00b87d8619984c34ae0508fce4d77a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b4ce64-3851-4c23-99a7-145a016e5ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b4ce64-3851-4c23-99a7-145a016e5ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ef5c16-f5b1-4081-992a-c867fb072ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ef5c16-f5b1-4081-992a-c867fb072ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5c699d-06e8-4fc5-9897-9c430daecb2b', 'volume_name': 'volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1476c91-cf3e-4596-a2a1-a59b20d384a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1476c91-cf3e-4596-a2a1-a59b20d384a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c1df2e-ec20-492d-a528-a067e63627e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:58 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Volume fa5c699d-06e8-4fc5-9897-9c430daecb2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b', 'volume_size': 1} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1883193470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5c699d-06e8-4fc5-9897-9c430daecb2b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8b6fa646c392417a8bf7e0617d70b324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:38:58Z,use_quota=True,user_id='00b87d8619984c34ae0508fce4d77a2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Creating volume fa5c699d-06e8-4fc5-9897-9c430daecb2b {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:38:58 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:58 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b 1073741824 Sep 29 16:38:58 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:58 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31" returned: 0 in 0.409s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:58 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31 Sep 29 16:38:58 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:59 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b 1073741824" returned: 0 in 0.584s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:38:59 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0.511ca823-f030-4598-96d1-d7fd8f75aa31" returned: 0 in 0.371s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:59 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b Sep 29 16:38:59 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:38:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Lock "cinder-quobyte-511ca823-f030-4598-96d1-d7fd8f75aa31" released by "_delete_snapshot" :: held 2.003s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:38:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Lock "cinder-quobyte-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0" released by "delete_snapshot" :: held 2.076s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:38:59 devstack cinder-volume[86793]: WARNING cinder.quota [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-28360721 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-28360721, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:38:59 devstack cinder-volume[86793]: WARNING cinder.quota [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-28360721 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-28360721, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:38:59 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] Created reservations ['f91812a8-b519-4c6b-947c-7d6d3fa8d4ca', '5055be1e-0406-44f0-90c0-be79f4feb6c1', '06bd7676-4141-423d-8744-8e5d112500d5', '1fc1300c-8eb3-484f-a9ea-505608f417b2'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:38:59 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-50977c01-2b01-42b6-ae79-a281e6f5bf8c tempest-GroupSnapshotsV319Test-791042284 None] group_snapshot 3feccb94-409f-4d4a-8026-e10f0d2332cf: deleted successfully Sep 29 16:38:59 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Sep 29 16:38:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b" returned: 0 in 0.390s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:38:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:38:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:38:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c1df2e-ec20-492d-a528-a067e63627e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c3949c-4ba2-4317-b22d-61edbda6599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:38:59 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Volume volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b (fa5c699d-06e8-4fc5-9897-9c430daecb2b): created successfully Sep 29 16:38:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c3949c-4ba2-4317-b22d-61edbda6599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:38:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Flow 'volume_create_manager' (15a82253-cbac-438b-aa81-074ca6677a69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:38:59 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fbe2789e-029c-422d-aff9-f81fe9783c4b tempest-VolumesListTestJSON-516547032 None] Created volume successfully. Sep 29 16:39:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Acquiring lock "cinder-quobyte-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Lock "cinder-quobyte-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:00 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce419bd-ce3e-4416-945d-0108013dd5b8]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:00 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 Sep 29 16:39:00 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:00 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0" returned: 0 in 0.599s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:00 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0 Sep 29 16:39:00 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:01 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0" returned: 0 in 0.412s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Lock "cinder-quobyte-8e6cb05d-d2d9-4f9e-8e24-67c95ed3dfb0" released by "delete_volume" :: held 1.113s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:01 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Created reservations ['d1c3a96b-9047-4689-b353-7630cf701354'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:39:01 devstack cinder-volume[86793]: WARNING cinder.quota [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-28360721 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-28360721, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:39:01 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Created reservations ['59a99238-5721-4ebb-838c-462119274891', '7768a1da-432e-4531-8c6b-d9f892aafddf', '44a9bc32-2a22-47f4-a363-70f5aadc3dca', 'f50a67d7-18c1-4650-a0b8-dff94eb3ec43'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:39:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:01 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:39:01 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:01 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.388s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:01 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:39:02 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5e3f6ea3-1b8e-4bec-9da0-f9e8602a076d tempest-GroupSnapshotsV319Test-791042284 None] Delete group completed successfully. Sep 29 16:39:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Acquiring lock "cinder-fa5c699d-06e8-4fc5-9897-9c430daecb2b-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Lock "cinder-fa5c699d-06e8-4fc5-9897-9c430daecb2b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Acquiring lock "cinder-quobyte-fa5c699d-06e8-4fc5-9897-9c430daecb2b" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Lock "cinder-quobyte-fa5c699d-06e8-4fc5-9897-9c430daecb2b" acquired by "delete_volume" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:03 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0aeb2c-fda8-48d0-92ee-25ff2bd146b0]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:03 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b Sep 29 16:39:03 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:03 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b" returned: 0 in 0.399s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:03 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b Sep 29 16:39:03 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:04 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa5c699d-06e8-4fc5-9897-9c430daecb2b" returned: 0 in 0.303s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Lock "cinder-quobyte-fa5c699d-06e8-4fc5-9897-9c430daecb2b" released by "delete_volume" :: held 0.772s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Created reservations ['9cec9b15-f37d-44b3-8d4e-161f4aab21c3', '4da82fb4-c606-4ca4-a0b8-07e94da0c449', '46f9717f-9229-4508-9b47-a0019e47b565', '41b727c9-29c9-4db6-8668-16a92998d423'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:04 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:39:04 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Acquiring lock "cinder-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Lock "cinder-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:04 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.376s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Acquiring lock "cinder-quobyte-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:04 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Deleted volume successfully. Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Lock "cinder-quobyte-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf" acquired by "delete_volume" :: waited 0.034s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3c429072-8994-4b44-9203-d796d96f1fac tempest-VolumesListTestJSON-516547032 None] Lock "cinder-fa5c699d-06e8-4fc5-9897-9c430daecb2b-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[97234ebc-7d1f-4bcf-a4c5-c8330d35ad00]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:04 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf Sep 29 16:39:04 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:05 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf" returned: 0 in 0.443s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:05 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf Sep 29 16:39:05 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:05 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf" returned: 0 in 0.305s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Lock "cinder-quobyte-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf" released by "delete_volume" :: held 0.800s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Created reservations ['92f0b19f-09bb-49ba-b36a-7149cbea890d', '78d90467-c7ea-412e-ae85-b6fa0bc677b3', 'e19fadfa-5b49-459a-bf8a-4cedb112ef0e', 'cb33a9fc-1785-4019-bc4e-2a21c4ca9d3e'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:05 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:39:05 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Acquiring lock "cinder-dbf218e4-4770-499a-8601-6f6817004fa6-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Lock "cinder-dbf218e4-4770-499a-8601-6f6817004fa6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Acquiring lock "cinder-quobyte-dbf218e4-4770-499a-8601-6f6817004fa6" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Lock "cinder-quobyte-dbf218e4-4770-499a-8601-6f6817004fa6" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77c8cd7-d59e-4aa3-bd18-f943909dd6b5]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dbf218e4-4770-499a-8601-6f6817004fa6 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:05 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.376s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:39:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Deleted volume successfully. Sep 29 16:39:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-249473bb-fc44-475d-87c1-96fd6a3e038b tempest-VolumesListTestJSON-516547032 None] Lock "cinder-59143f3b-4d5f-4d40-ba7a-459ba3b5a4cf-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-51e8eba3-5073-4605-986d-d42f8277f503 tempest-GroupsV314Test-1277795760 None] Group tempest-GroupsV314Test-Group-622811418: creating Sep 29 16:39:06 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dbf218e4-4770-499a-8601-6f6817004fa6 Sep 29 16:39:06 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-51e8eba3-5073-4605-986d-d42f8277f503 tempest-GroupsV314Test-1277795760 None] Group tempest-GroupsV314Test-Group-622811418: created successfully Sep 29 16:39:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-51e8eba3-5073-4605-986d-d42f8277f503 tempest-GroupsV314Test-1277795760 None] Create group completed successfully. Sep 29 16:39:06 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dbf218e4-4770-499a-8601-6f6817004fa6" returned: 0 in 0.438s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dbf218e4-4770-499a-8601-6f6817004fa6 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:06 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dbf218e4-4770-499a-8601-6f6817004fa6 Sep 29 16:39:06 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:06 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dbf218e4-4770-499a-8601-6f6817004fa6" returned: 0 in 0.260s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Lock "cinder-quobyte-dbf218e4-4770-499a-8601-6f6817004fa6" released by "delete_volume" :: held 0.757s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:06 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Created reservations ['2d63df84-8719-42be-9921-35636688ad7c', '4342e142-b2eb-471a-a422-0e8f01ff0e99', '9aadbdb6-1f03-4164-a5a1-464726d19d00', '52255806-c5d4-4147-94a8-107191e77a98'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:39:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:06 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:39:06 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:07 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.281s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:39:07 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Deleted volume successfully. Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c21c0230-b61a-473a-961a-a0d9cc9fe4dd tempest-VolumesListTestJSON-516547032 None] Lock "cinder-dbf218e4-4770-499a-8601-6f6817004fa6-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Flow 'volume_create_manager' (7f09fc42-e78f-4147-aca9-74117e51ffcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc4f561-7025-4fbd-9ba0-854ebee34094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc4f561-7025-4fbd-9ba0-854ebee34094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-715802721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=913f1d26-b078-42b8-879d-f78bbf8d01c7,host='devstack@QuobyteHD#QuobyteHD',id=710d096f-9bde-4b71-b57c-cfec3385ac7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bab3d7c00749da94f1d55bea56c4e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:08Z,use_quota=True,user_id='0800a14d7bc043348a565324f8d3d588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fac36d4-d4ff-42fb-b00b-7848a679fa6d),volume_type_id=6fac36d4-d4ff-42fb-b00b-7848a679fa6d)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f53c02-9c2d-4190-8b79-bdeb15d350a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f53c02-9c2d-4190-8b79-bdeb15d350a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc5275c-eb09-4d2b-ae27-c6c06b3f145f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc5275c-eb09-4d2b-ae27-c6c06b3f145f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '710d096f-9bde-4b71-b57c-cfec3385ac7a', 'volume_name': 'volume-710d096f-9bde-4b71-b57c-cfec3385ac7a', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b40a39-042b-4443-8da0-2a47ae14b57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b40a39-042b-4443-8da0-2a47ae14b57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b672023b-0f0e-4123-be78-247009d89c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:07 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Volume 710d096f-9bde-4b71-b57c-cfec3385ac7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-710d096f-9bde-4b71-b57c-cfec3385ac7a', 'volume_size': 1} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=913f1d26-b078-42b8-879d-f78bbf8d01c7,created_at=2026-09-29T14:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-715802721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=913f1d26-b078-42b8-879d-f78bbf8d01c7,host='devstack@QuobyteHD#QuobyteHD',id=710d096f-9bde-4b71-b57c-cfec3385ac7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74bab3d7c00749da94f1d55bea56c4e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:08Z,use_quota=True,user_id='0800a14d7bc043348a565324f8d3d588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fac36d4-d4ff-42fb-b00b-7848a679fa6d),volume_type_id=6fac36d4-d4ff-42fb-b00b-7848a679fa6d)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Creating volume 710d096f-9bde-4b71-b57c-cfec3385ac7a {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:39:07 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:39:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:07 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a 1073741824 Sep 29 16:39:07 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:08 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a 1073741824" returned: 0 in 0.620s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:08 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a Sep 29 16:39:08 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:08 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a" returned: 0 in 0.310s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:39:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b672023b-0f0e-4123-be78-247009d89c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-710d096f-9bde-4b71-b57c-cfec3385ac7a', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f35911-5931-4c37-beb6-0a198a536107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:08 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Volume volume-710d096f-9bde-4b71-b57c-cfec3385ac7a (710d096f-9bde-4b71-b57c-cfec3385ac7a): created successfully Sep 29 16:39:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f35911-5931-4c37-beb6-0a198a536107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Flow 'volume_create_manager' (7f09fc42-e78f-4147-aca9-74117e51ffcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:39:08 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-55d80143-75e2-44c2-b8e1-8d4261f43206 tempest-GroupsV314Test-1277795760 None] Created volume successfully. Sep 29 16:39:09 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-bfdc0973-9b15-4ac8-8b1f-d730b050a7c3 tempest-GroupsV320Test-204353923 None] Group tempest-GroupsV320Test-Group-318512481: creating Sep 29 16:39:09 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-bfdc0973-9b15-4ac8-8b1f-d730b050a7c3 tempest-GroupsV320Test-204353923 None] Group tempest-GroupsV320Test-Group-318512481: created successfully Sep 29 16:39:09 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-bfdc0973-9b15-4ac8-8b1f-d730b050a7c3 tempest-GroupsV320Test-204353923 None] Create group completed successfully. Sep 29 16:39:10 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=131,cinder:SELECT=108,cinder:INSERT=36,cinder:DELETE=9 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:39:10 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=114,cinder:UPDATE=128,cinder:INSERT=22,cinder:DELETE=8 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:39:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:10 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Cloning volume 710d096f-9bde-4b71-b57c-cfec3385ac7a to volume d0921cb1-cffd-49d5-8834-f707c7cc3c83 Sep 29 16:39:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Creating offline snapshot 42d53f6c-6583-4fe5-960f-134b18521f2b of volume 710d096f-9bde-4b71-b57c-cfec3385ac7a {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:39:10 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[338d0627-9d00-4d59-a7d9-8c6abdc5790c]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:11 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a Sep 29 16:39:11 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:11 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a" returned: 0 in 0.495s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:11 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b 1G Sep 29 16:39:11 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:11 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-7c7144bd-27a6-4bbe-b961-6778c320637e tempest-GroupsV320Test-204353923 None] Created reservations ['3519f2a5-24f0-4f7b-abf5-837e56641430'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:39:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c7144bd-27a6-4bbe-b961-6778c320637e tempest-GroupsV320Test-204353923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c7144bd-27a6-4bbe-b961-6778c320637e tempest-GroupsV320Test-204353923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7c7144bd-27a6-4bbe-b961-6778c320637e tempest-GroupsV320Test-204353923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7c7144bd-27a6-4bbe-b961-6778c320637e tempest-GroupsV320Test-204353923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c7144bd-27a6-4bbe-b961-6778c320637e tempest-GroupsV320Test-204353923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7c7144bd-27a6-4bbe-b961-6778c320637e tempest-GroupsV320Test-204353923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:11 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:39:11 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:11 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b 1G" returned: 0 in 0.527s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-710d096f-9bde-4b71-b57c-cfec3385ac7a -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:12 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-710d096f-9bde-4b71-b57c-cfec3385ac7a -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b Sep 29 16:39:12 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Flow 'volume_create_manager' (97525108-b8aa-43c5-85b0-ce655973e566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89264be2-9681-4223-9a71-9ea475c32c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:12 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7c7144bd-27a6-4bbe-b961-6778c320637e tempest-GroupsV320Test-204353923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.340s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7c7144bd-27a6-4bbe-b961-6778c320637e tempest-GroupsV320Test-204353923 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:39:12 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7c7144bd-27a6-4bbe-b961-6778c320637e tempest-GroupsV320Test-204353923 None] Delete group completed successfully. Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89264be2-9681-4223-9a71-9ea475c32c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-461944537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505dd0d6-83e5-49c8-aebb-9d5cf009e9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d1bdcb5fd724e3b8ab5f21e28126664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:12Z,use_quota=True,user_id='eab5973d6fb34372af6fd1a378934f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff039029-c9fc-490d-ba1e-4ad4988dc226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff039029-c9fc-490d-ba1e-4ad4988dc226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707cc495-62dc-446c-bb4f-abb9d8cfb364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707cc495-62dc-446c-bb4f-abb9d8cfb364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '505dd0d6-83e5-49c8-aebb-9d5cf009e9dc', 'volume_name': 'volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc', 'volume_size': 2}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c289f2-a0d7-4493-9768-dd4382f63d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c289f2-a0d7-4493-9768-dd4382f63d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37504fdd-6563-43f8-b707-64e6ce238ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:12 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Volume 505dd0d6-83e5-49c8-aebb-9d5cf009e9dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc', 'volume_size': 2} Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:12 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-710d096f-9bde-4b71-b57c-cfec3385ac7a -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b" returned: 0 in 0.357s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:12 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b is being set with open permissions: ugo+rw: NotImplementedError Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:12 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b Sep 29 16:39:12 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:12 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b" returned: 0 in 0.274s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:12 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.info Sep 29 16:39:12 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:12 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.info" returned: 0 in 0.301s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:12 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 16:39:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:12 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.info Sep 29 16:39:12 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:13 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.info" returned: 0 in 0.440s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Acquiring lock "cinder-quobyte-d0921cb1-cffd-49d5-8834-f707c7cc3c83" by "_copy_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Lock "cinder-quobyte-d0921cb1-cffd-49d5-8834-f707c7cc3c83" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] snapshot: 42d53f6c-6583-4fe5-960f-134b18521f2b, volume: d0921cb1-cffd-49d5-8834-f707c7cc3c83, {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 16:39:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:13 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efbfa23-ab07-4221-a007-976864561cc2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:13 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b Sep 29 16:39:13 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:14 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b" returned: 0 in 0.566s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-710d096f-9bde-4b71-b57c-cfec3385ac7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:39:14 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc03ffeb-278e-4980-8aee-545f0b8b9229]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:14 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a Sep 29 16:39:14 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:14 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a" returned: 0 in 0.442s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] will copy from snapshot at /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 16:39:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Creating direct copy from snapshot {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 16:39:14 devstack cinder-volume[86793]: DEBUG cinder.utils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Path /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83 not found in is_blk_device check {{(pid=86793) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 16:39:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:14 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83 Sep 29 16:39:14 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:20 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-e9130123-5e0b-4009-a91e-6e14991dd739 req-866a609e-abe1-4f94-b5ee-9d1621c11255 tempest-AttachVolumeNegativeTest-2009311936 None] Terminate volume connection completed successfully. Sep 29 16:39:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-e9130123-5e0b-4009-a91e-6e14991dd739 req-866a609e-abe1-4f94-b5ee-9d1621c11255 tempest-AttachVolumeNegativeTest-2009311936 None] Deleting attachment 6f61df00-e178-4c3b-b720-7b99a660f458. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:39:23 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83" returned: 0 in 8.994s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:23 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a, size 1024.00 MB, duration 9.00 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:39:23 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Converted 1024.00 MB image at 113.83 MB/s Sep 29 16:39:23 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 16:39:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:23 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83 Sep 29 16:39:23 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:23 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83" returned: 0 in 0.302s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Lock "cinder-quobyte-d0921cb1-cffd-49d5-8834-f707c7cc3c83" released by "_copy_volume_from_snapshot" :: held 10.433s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Acquiring lock "cinder-quobyte-42d53f6c-6583-4fe5-960f-134b18521f2b" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Lock "cinder-quobyte-42d53f6c-6583-4fe5-960f-134b18521f2b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Deleting offline snapshot 42d53f6c-6583-4fe5-960f-134b18521f2b of volume 710d096f-9bde-4b71-b57c-cfec3385ac7a {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:39:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] snapshot_file for this snap is: volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:39:24 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8307b9-758d-4892-a4e8-d3a09a0ed170]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:24 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b Sep 29 16:39:24 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:24 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b" returned: 0 in 0.470s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-710d096f-9bde-4b71-b57c-cfec3385ac7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:39:24 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c660d71-53ee-4865-a194-10be698622ed]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:24 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a Sep 29 16:39:24 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:25 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a" returned: 0 in 0.641s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:25 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b Sep 29 16:39:25 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:25 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b" returned: 0 in 0.498s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:25 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b Sep 29 16:39:25 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:25 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a.42d53f6c-6583-4fe5-960f-134b18521f2b" returned: 0 in 0.243s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Lock "cinder-quobyte-42d53f6c-6583-4fe5-960f-134b18521f2b" released by "_delete_snapshot" :: held 1.987s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.094s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.758s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-461944537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505dd0d6-83e5-49c8-aebb-9d5cf009e9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d1bdcb5fd724e3b8ab5f21e28126664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:12Z,use_quota=True,user_id='eab5973d6fb34372af6fd1a378934f6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Creating volume 505dd0d6-83e5-49c8-aebb-9d5cf009e9dc {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:39:25 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:39:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc 2147483648 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:26 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc 2147483648 Sep 29 16:39:26 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:26 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-01400f79-7f0e-4cd2-bcb7-a0d9d1bded0b tempest-GroupsV314Test-1277795760 None] Create group from source-group-913f1d26-b078-42b8-879d-f78bbf8d01c7 completed successfully. Sep 29 16:39:26 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc 2147483648" returned: 0 in 0.606s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:26 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc Sep 29 16:39:26 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:26 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc" returned: 0 in 0.315s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:39:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37504fdd-6563-43f8-b707-64e6ce238ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc', 'volume_size': 2}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59eb94b1-05f2-4f2d-be6e-8dfbe14b5280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:26 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Volume volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc (505dd0d6-83e5-49c8-aebb-9d5cf009e9dc): created successfully Sep 29 16:39:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59eb94b1-05f2-4f2d-be6e-8dfbe14b5280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Flow 'volume_create_manager' (97525108-b8aa-43c5-85b0-ce655973e566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:39:27 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-abba9c81-f5cf-47ed-8de2-f5d3066d7a49 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Created volume successfully. Sep 29 16:39:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Acquiring lock "cinder-quobyte-d0921cb1-cffd-49d5-8834-f707c7cc3c83" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Lock "cinder-quobyte-d0921cb1-cffd-49d5-8834-f707c7cc3c83" acquired by "delete_volume" :: waited 0.027s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:27 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca55916-29bd-45b6-a212-d7e22b653ae9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:27 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83 Sep 29 16:39:27 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:27 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83" returned: 0 in 0.550s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:27 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83 Sep 29 16:39:27 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Creating offline snapshot 71910459-d38b-4d92-9aff-ff7a37d387c4 of volume 505dd0d6-83e5-49c8-aebb-9d5cf009e9dc {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:39:27 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f54905-0f07-46bf-af0b-73498460f4f9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:28 devstack sudo[96792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc Sep 29 16:39:28 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:28 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d0921cb1-cffd-49d5-8834-f707c7cc3c83" returned: 0 in 0.352s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Lock "cinder-quobyte-d0921cb1-cffd-49d5-8834-f707c7cc3c83" released by "delete_volume" :: held 0.978s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:28 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Created reservations ['2352b679-e131-486e-a0ff-12b5fd6b1c2e'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:39:28 devstack cinder-volume[86793]: WARNING cinder.quota [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2137523760 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2137523760, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:39:28 devstack cinder-volume[86793]: WARNING cinder.quota [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2137523760 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2137523760, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:39:28 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Created reservations ['c1bbcec3-cddd-4245-9bb9-d09660e95ad9', 'cb1494c1-1c7d-422c-b0c7-5603e3305a81', 'efa381f6-11d9-4525-8e35-c3b48ddf971d', '1f150214-c2c1-4501-ac2d-aaae6e9cb31b'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:39:28 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc" returned: 0 in 0.476s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 2G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:28 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 2G Sep 29 16:39:28 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:28 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:39:28 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:28 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.415s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:28 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:39:28 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a2f56b50-330f-4011-80ab-cdd31a00e0d9 tempest-GroupsV314Test-1277795760 None] Delete group completed successfully. Sep 29 16:39:29 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 2G" returned: 0 in 0.584s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:29 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 Sep 29 16:39:29 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:29 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4" returned: 0 in 0.343s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:29 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 is being set with open permissions: ugo+rw Sep 29 16:39:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:29 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 Sep 29 16:39:29 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:29 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4" returned: 0 in 0.283s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:29 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.info Sep 29 16:39:29 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Acquiring lock "cinder-quobyte-710d096f-9bde-4b71-b57c-cfec3385ac7a" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Lock "cinder-quobyte-710d096f-9bde-4b71-b57c-cfec3385ac7a" acquired by "delete_volume" :: waited 0.027s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdd9356-a1bc-4f31-81ea-ddff6facfcea]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:30 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.info" returned: 0 in 0.328s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:30 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.info is being set with open permissions: ugo+rw Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:30 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.info Sep 29 16:39:30 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:30 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a Sep 29 16:39:30 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:30 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.info" returned: 0 in 0.312s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:30 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fc655471-2000-4113-a382-261c10ce61c4 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Create snapshot completed successfully Sep 29 16:39:30 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a" returned: 0 in 0.475s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:30 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a Sep 29 16:39:30 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:30 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-710d096f-9bde-4b71-b57c-cfec3385ac7a" returned: 0 in 0.296s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Lock "cinder-quobyte-710d096f-9bde-4b71-b57c-cfec3385ac7a" released by "delete_volume" :: held 0.859s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Flow 'volume_create_manager' (fc828fb9-bbfe-4c27-8d12-a385df040544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9481740-43f0-470d-a411-06d74ee76f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9481740-43f0-470d-a411-06d74ee76f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1720488394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c32a2f-4fec-4eb8-98a8-7e518442a458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c540eefeec2143f593c71a2178f1f15b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:31Z,use_quota=True,user_id='891e13963c46412d99d0c0bc03ae2c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ff2cc0-d390-4b65-b4e6-8c36b220497f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ff2cc0-d390-4b65-b4e6-8c36b220497f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b9d51b-f694-4e80-b13e-2ed516c17e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b9d51b-f694-4e80-b13e-2ed516c17e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7c32a2f-4fec-4eb8-98a8-7e518442a458', 'volume_name': 'volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8175019c-567c-42e4-9600-46c09455b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8175019c-567c-42e4-9600-46c09455b949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033bb132-af91-4dee-9384-1280775521e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:30 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Volume b7c32a2f-4fec-4eb8-98a8-7e518442a458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458', 'volume_size': 1} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1720488394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7c32a2f-4fec-4eb8-98a8-7e518442a458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c540eefeec2143f593c71a2178f1f15b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:31Z,use_quota=True,user_id='891e13963c46412d99d0c0bc03ae2c5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Creating volume b7c32a2f-4fec-4eb8-98a8-7e518442a458 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:39:30 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:39:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:30 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458 1073741824 Sep 29 16:39:30 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Created reservations ['1490765a-20c1-4a2b-abc4-1b6f2beec534'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Created reservations ['e885b4e7-bb1d-4a8e-9133-a62509e3f081', 'af6a95ba-69d9-4765-8f88-2dec1fc154c0', '5c4760f4-93d9-41f2-9dcf-5cb43c05b559', 'e7c4d44d-8039-4010-9769-53f2b0eff961'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Acquiring lock "cinder-71910459-d38b-4d92-9aff-ff7a37d387c4-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:31 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:39:31 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "cinder-71910459-d38b-4d92-9aff-ff7a37d387c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Acquiring lock "cinder-quobyte-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "cinder-quobyte-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Acquiring lock "cinder-quobyte-71910459-d38b-4d92-9aff-ff7a37d387c4" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "cinder-quobyte-71910459-d38b-4d92-9aff-ff7a37d387c4" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Deleting offline snapshot 71910459-d38b-4d92-9aff-ff7a37d387c4 of volume 505dd0d6-83e5-49c8-aebb-9d5cf009e9dc {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] snapshot_file for this snap is: volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ba4697-6f2c-4fca-9ba7-e45e6f53f86e]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:31 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 Sep 29 16:39:31 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:31 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.383s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:39:31 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e7528104-09f0-4f42-9c79-3b97d235666b tempest-GroupsV314Test-1277795760 None] Delete group completed successfully. Sep 29 16:39:31 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458 1073741824" returned: 0 in 0.723s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:31 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458 Sep 29 16:39:31 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:31 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4" returned: 0 in 0.551s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:39:32 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3cba6a-9513-4c2b-a6cc-89e6c351ea3d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:32 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458" returned: 0 in 0.341s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:39:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (033bb132-af91-4dee-9384-1280775521e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9682b632-0661-4a5c-a80e-56d6fb20f3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:32 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Volume volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458 (b7c32a2f-4fec-4eb8-98a8-7e518442a458): created successfully Sep 29 16:39:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9682b632-0661-4a5c-a80e-56d6fb20f3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Flow 'volume_create_manager' (fc828fb9-bbfe-4c27-8d12-a385df040544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:39:32 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-22976802-a7f8-48fd-aa2e-cff0417379c0 tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Created volume successfully. Sep 29 16:39:32 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc Sep 29 16:39:32 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:32 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc" returned: 0 in 0.470s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:32 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 Sep 29 16:39:32 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:32 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4" returned: 0 in 0.481s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:33 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4 Sep 29 16:39:33 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:33 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc.71910459-d38b-4d92-9aff-ff7a37d387c4" returned: 0 in 0.384s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "cinder-quobyte-71910459-d38b-4d92-9aff-ff7a37d387c4" released by "_delete_snapshot" :: held 2.069s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "cinder-quobyte-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc" released by "delete_snapshot" :: held 2.114s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:33 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Created reservations ['6c5bb0c2-3d53-4d01-a693-2f028db5e5c1', '20ac406b-e810-4b47-bc85-f910d3acc3d4', 'a268b814-cb3d-49b2-a1b2-b7603f950d8a', 'd6f5941d-ac7b-4d21-badb-d29bda93e8cd'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:39:33 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Delete snapshot completed successfully. Sep 29 16:39:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-36c3421f-af13-4de5-b388-cb55b2bbe848 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "cinder-71910459-d38b-4d92-9aff-ff7a37d387c4-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Acquiring lock "cinder-b7c32a2f-4fec-4eb8-98a8-7e518442a458-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Lock "cinder-b7c32a2f-4fec-4eb8-98a8-7e518442a458-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Acquiring lock "cinder-quobyte-b7c32a2f-4fec-4eb8-98a8-7e518442a458" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Lock "cinder-quobyte-b7c32a2f-4fec-4eb8-98a8-7e518442a458" acquired by "delete_volume" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[747d738f-3d9e-444e-877a-a2cb44832085]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:34 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458 Sep 29 16:39:34 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Acquiring lock "cinder-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "cinder-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:34 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:39:34 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Acquiring lock "cinder-quobyte-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "cinder-quobyte-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc" acquired by "delete_volume" :: waited 0.036s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:34 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458" returned: 0 in 0.509s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14223a9-0b9b-4de2-a02e-123aa572db54]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:35 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458 Sep 29 16:39:35 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:35 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc Sep 29 16:39:35 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:35 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.337s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:39:35 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b7c32a2f-4fec-4eb8-98a8-7e518442a458" returned: 0 in 0.399s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Lock "cinder-quobyte-b7c32a2f-4fec-4eb8-98a8-7e518442a458" released by "delete_volume" :: held 0.956s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Created reservations ['d583721a-0eb8-4fc9-b0b5-7eca14a741ba', '7c49b54f-65bf-44f8-a865-fa8002e252b5', '41939e92-21d7-4a0a-ad4b-b07bf13b8e6e', '3903d2dc-d5e4-4626-a876-2b1fce14dec5'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:39:35 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc" returned: 0 in 0.529s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:35 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc Sep 29 16:39:35 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:35 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:39:35 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:35 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc" returned: 0 in 0.412s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "cinder-quobyte-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc" released by "delete_volume" :: held 1.054s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:35 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.353s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:39:35 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Deleted volume successfully. Sep 29 16:39:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ca606cac-1065-45e4-acf0-ab5f6e85482a tempest-VolumeQuotasNegativeTestJSON-1874840266 None] Lock "cinder-b7c32a2f-4fec-4eb8-98a8-7e518442a458-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:36 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Created reservations ['1497ed46-c774-4a6a-acf2-64dde656b723', 'bacb98f5-6a93-4092-8a68-c9bc855b44ba', 'd7a4cff8-66c3-444b-b7fc-041671cd84aa', 'c766fdd7-94c4-4f4e-bdaa-4ebb0a423092'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:39:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:36 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:39:36 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:36 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.561s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:36 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:39:36 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Deleted volume successfully. Sep 29 16:39:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c67166d9-1eaf-4398-9a45-58c0d6eee673 tempest-VolumesSnapshotNegativeTestJSON-1890055174 None] Lock "cinder-505dd0d6-83e5-49c8-aebb-9d5cf009e9dc-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:46 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:INSERT=9,cinder:SELECT=50,cinder:UPDATE=60 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:39:46 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=53,cinder:UPDATE=53,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Flow 'volume_create_manager' (153ab1c0-2829-45b0-a0dc-39274072ff5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48eda617-1ef0-4d2b-aa63-41fe6b166554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48eda617-1ef0-4d2b-aa63-41fe6b166554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-969634603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db5dbae-ae32-4c6e-a269-100eb0feb467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5153c256f4a84c3fb08fd7688aefb874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:48Z,use_quota=True,user_id='e7e18ba1525343419f1f8099c0671c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7072b54-1312-4d88-abb5-4d9b3f576c52),volume_type_id=d7072b54-1312-4d88-abb5-4d9b3f576c52)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f83ecc-53cc-421f-a1eb-ec3a2cacc82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8f83ecc-53cc-421f-a1eb-ec3a2cacc82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38570944-d3dd-4e15-8582-cd2c71d03582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38570944-d3dd-4e15-8582-cd2c71d03582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db5dbae-ae32-4c6e-a269-100eb0feb467', 'volume_name': 'volume-8db5dbae-ae32-4c6e-a269-100eb0feb467', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5903bc37-e182-4b42-975f-118e7b45df5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5903bc37-e182-4b42-975f-118e7b45df5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71094850-fad7-4c67-b7af-16393f788487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:48 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Volume 8db5dbae-ae32-4c6e-a269-100eb0feb467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db5dbae-ae32-4c6e-a269-100eb0feb467', 'volume_size': 1} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-969634603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db5dbae-ae32-4c6e-a269-100eb0feb467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5153c256f4a84c3fb08fd7688aefb874',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:39:48Z,use_quota=True,user_id='e7e18ba1525343419f1f8099c0671c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7072b54-1312-4d88-abb5-4d9b3f576c52),volume_type_id=d7072b54-1312-4d88-abb5-4d9b3f576c52)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Creating volume 8db5dbae-ae32-4c6e-a269-100eb0feb467 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:39:48 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:39:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8db5dbae-ae32-4c6e-a269-100eb0feb467 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:48 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8db5dbae-ae32-4c6e-a269-100eb0feb467 1073741824 Sep 29 16:39:48 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:49 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8db5dbae-ae32-4c6e-a269-100eb0feb467 1073741824" returned: 0 in 0.648s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8db5dbae-ae32-4c6e-a269-100eb0feb467 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:49 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8db5dbae-ae32-4c6e-a269-100eb0feb467 Sep 29 16:39:49 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:49 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8db5dbae-ae32-4c6e-a269-100eb0feb467" returned: 0 in 0.526s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:39:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71094850-fad7-4c67-b7af-16393f788487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db5dbae-ae32-4c6e-a269-100eb0feb467', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd7ee3a-8aff-4149-be5c-007998e65598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:39:49 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Volume volume-8db5dbae-ae32-4c6e-a269-100eb0feb467 (8db5dbae-ae32-4c6e-a269-100eb0feb467): created successfully Sep 29 16:39:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dd7ee3a-8aff-4149-be5c-007998e65598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:39:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Flow 'volume_create_manager' (153ab1c0-2829-45b0-a0dc-39274072ff5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:39:49 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-8cae8302-1543-430a-92c2-2223018d8bdf tempest-VolumeTypesAccessTest-710254861 None] Created volume successfully. Sep 29 16:39:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Acquiring lock "cinder-8db5dbae-ae32-4c6e-a269-100eb0feb467-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Lock "cinder-8db5dbae-ae32-4c6e-a269-100eb0feb467-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Acquiring lock "cinder-quobyte-8db5dbae-ae32-4c6e-a269-100eb0feb467" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:39:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Lock "cinder-quobyte-8db5dbae-ae32-4c6e-a269-100eb0feb467" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:39:51 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[820a21f0-2a36-4e25-b172-2221eb9c116b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:39:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8db5dbae-ae32-4c6e-a269-100eb0feb467 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:51 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8db5dbae-ae32-4c6e-a269-100eb0feb467 Sep 29 16:39:51 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:51 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8db5dbae-ae32-4c6e-a269-100eb0feb467" returned: 0 in 0.567s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8db5dbae-ae32-4c6e-a269-100eb0feb467 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:51 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8db5dbae-ae32-4c6e-a269-100eb0feb467 Sep 29 16:39:51 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:52 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8db5dbae-ae32-4c6e-a269-100eb0feb467" returned: 0 in 0.308s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Lock "cinder-quobyte-8db5dbae-ae32-4c6e-a269-100eb0feb467" released by "delete_volume" :: held 0.964s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:39:52 devstack cinder-volume[86793]: WARNING cinder.quota [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-811819845 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-811819845, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:39:52 devstack cinder-volume[86793]: WARNING cinder.quota [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-811819845 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-811819845, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:39:52 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Created reservations ['89ffae87-8ae7-49f3-91e6-15108c719445', '59fff59b-74af-4a29-bf34-77b2cff3b0e6', 'efa0cb81-474e-4c01-a6a0-635ea8c1af6b', '3cf4b274-c110-444f-812e-00f2963a8f98'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:39:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:39:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:39:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:39:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:39:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:39:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:39:52 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:39:52 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:39:52 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 29 16:39:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.348s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:39:52 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:39:52 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Deleted volume successfully. Sep 29 16:39:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-27fc15b2-5552-4549-a42f-23a877b48a60 tempest-VolumeTypesAccessTest-710254861 None] Lock "cinder-8db5dbae-ae32-4c6e-a269-100eb0feb467-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=10,cinder:UPDATE=9,cinder:INSERT=5 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=13,cinder:SELECT=4,cinder:DELETE=2 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Flow 'volume_create_manager' (4b57d64b-21be-4bcf-8479-621e1f4ed613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f06c85-1425-4501-a86b-64d137d5dd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f06c85-1425-4501-a86b-64d137d5dd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-471646877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3f814f-db14-49e4-bfad-d9f390c01924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d786a83201d1442c9e75f73b3820b78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:03Z,use_quota=True,user_id='871b5c15788e48a3962da7a471aff71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52d8b7e-322c-4acc-92af-d1e822177ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52d8b7e-322c-4acc-92af-d1e822177ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0527297f-1870-4e93-9e2b-bd705614eea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0527297f-1870-4e93-9e2b-bd705614eea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f3f814f-db14-49e4-bfad-d9f390c01924', 'volume_name': 'volume-1f3f814f-db14-49e4-bfad-d9f390c01924', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb64acc6-0b53-48ee-b2f3-38b735cb5723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb64acc6-0b53-48ee-b2f3-38b735cb5723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea9e9e7-e45d-4a2b-881b-1b9e7bfd5371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:02 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Volume 1f3f814f-db14-49e4-bfad-d9f390c01924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f3f814f-db14-49e4-bfad-d9f390c01924', 'volume_size': 1} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-471646877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f3f814f-db14-49e4-bfad-d9f390c01924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d786a83201d1442c9e75f73b3820b78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:03Z,use_quota=True,user_id='871b5c15788e48a3962da7a471aff71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Creating volume 1f3f814f-db14-49e4-bfad-d9f390c01924 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:40:02 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:40:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1f3f814f-db14-49e4-bfad-d9f390c01924 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:02 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1f3f814f-db14-49e4-bfad-d9f390c01924 1073741824 Sep 29 16:40:02 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:03 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1f3f814f-db14-49e4-bfad-d9f390c01924 1073741824" returned: 0 in 0.572s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1f3f814f-db14-49e4-bfad-d9f390c01924 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:03 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1f3f814f-db14-49e4-bfad-d9f390c01924 Sep 29 16:40:03 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:03 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1f3f814f-db14-49e4-bfad-d9f390c01924" returned: 0 in 0.442s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:40:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ea9e9e7-e45d-4a2b-881b-1b9e7bfd5371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f3f814f-db14-49e4-bfad-d9f390c01924', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (629b1053-543f-4467-8f10-dd4a1d6de7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:03 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Volume volume-1f3f814f-db14-49e4-bfad-d9f390c01924 (1f3f814f-db14-49e4-bfad-d9f390c01924): created successfully Sep 29 16:40:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (629b1053-543f-4467-8f10-dd4a1d6de7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Flow 'volume_create_manager' (4b57d64b-21be-4bcf-8479-621e1f4ed613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:04 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3e6f809e-171d-46d8-bd5d-27e9fa81433a tempest-AttachVolumeNegativeTest-2009311936 None] Created volume successfully. Sep 29 16:40:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-3753898f-647c-4a16-92f9-be1c3a42ec6a req-59efb350-a40e-4b8e-b087-c7b29b5d113b tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-3753898f-647c-4a16-92f9-be1c3a42ec6a req-59efb350-a40e-4b8e-b087-c7b29b5d113b tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-3753898f-647c-4a16-92f9-be1c3a42ec6a req-59efb350-a40e-4b8e-b087-c7b29b5d113b tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-3753898f-647c-4a16-92f9-be1c3a42ec6a req-59efb350-a40e-4b8e-b087-c7b29b5d113b tempest-AttachVolumeNegativeTest-2009311936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-1f3f814f-db14-49e4-bfad-d9f390c01924', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b044a3f-bc83-44d2-9385-a804cf6374bf', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:40:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-3753898f-647c-4a16-92f9-be1c3a42ec6a req-59efb350-a40e-4b8e-b087-c7b29b5d113b tempest-AttachVolumeNegativeTest-2009311936 None] attachment_update completed successfully. Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Flow 'volume_create_manager' (cc662264-0ac6-45df-96ff-191c8688429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2632233a-3cd2-4db9-9c14-c33790dcfb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2632233a-3cd2-4db9-9c14-c33790dcfb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-961086743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfef36c-0bb6-47bb-b24e-f771a355fa2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257872b5f2e14217b253172031bd0bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:09Z,use_quota=True,user_id='f9ffbcf94d4a4420b85bd4878a843005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2014ba-82de-4512-82b6-61fe71cbccaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2014ba-82de-4512-82b6-61fe71cbccaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ee6a95-aa13-4c49-9aff-2ab48977673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ee6a95-aa13-4c49-9aff-2ab48977673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dfef36c-0bb6-47bb-b24e-f771a355fa2a', 'volume_name': 'volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a872955-32a2-408e-bcb9-7adc4554b87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a872955-32a2-408e-bcb9-7adc4554b87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db1ff1b-14f5-473a-9f5b-0b57556d148e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:08 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Volume 4dfef36c-0bb6-47bb-b24e-f771a355fa2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a', 'volume_size': 1} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-961086743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dfef36c-0bb6-47bb-b24e-f771a355fa2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257872b5f2e14217b253172031bd0bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:09Z,use_quota=True,user_id='f9ffbcf94d4a4420b85bd4878a843005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Creating volume 4dfef36c-0bb6-47bb-b24e-f771a355fa2a {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:40:08 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:40:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:08 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a 1073741824 Sep 29 16:40:08 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:09 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:40:09 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Flow 'volume_create_manager' (25fc0760-3b18-409a-85d5-4f58f795657a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:09 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e22d01b-d0bc-4afa-a6db-60575b30396a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:09 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e22d01b-d0bc-4afa-a6db-60575b30396a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-263081126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a835876e-14f0-442f-9ff8-295868f30983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257872b5f2e14217b253172031bd0bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:09Z,use_quota=True,user_id='f9ffbcf94d4a4420b85bd4878a843005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:09 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd2eff1-f430-41aa-8cd6-41bbba0f3c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:09 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd2eff1-f430-41aa-8cd6-41bbba0f3c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:09 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234e08f4-9626-4c69-9b50-6c6b680e9e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:09 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234e08f4-9626-4c69-9b50-6c6b680e9e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a835876e-14f0-442f-9ff8-295868f30983', 'volume_name': 'volume-a835876e-14f0-442f-9ff8-295868f30983', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:09 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e411055-f504-49d7-9fcc-de7d09ac09fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:09 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e411055-f504-49d7-9fcc-de7d09ac09fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:09 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7810878d-e604-40f4-951e-b64a679f5e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:09 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Volume a835876e-14f0-442f-9ff8-295868f30983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a835876e-14f0-442f-9ff8-295868f30983', 'volume_size': 1} Sep 29 16:40:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:09 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a 1073741824" returned: 0 in 0.864s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:09 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a Sep 29 16:40:09 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:10 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a" returned: 0 in 0.357s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.450s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-263081126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a835876e-14f0-442f-9ff8-295868f30983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='257872b5f2e14217b253172031bd0bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:09Z,use_quota=True,user_id='f9ffbcf94d4a4420b85bd4878a843005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Creating volume a835876e-14f0-442f-9ff8-295868f30983 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:40:10 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a835876e-14f0-442f-9ff8-295868f30983 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db1ff1b-14f5-473a-9f5b-0b57556d148e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b4a5ed-326b-45e3-a385-cacb380dae2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:10 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a835876e-14f0-442f-9ff8-295868f30983 1073741824 Sep 29 16:40:10 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:10 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Volume volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a (4dfef36c-0bb6-47bb-b24e-f771a355fa2a): created successfully Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b4a5ed-326b-45e3-a385-cacb380dae2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Flow 'volume_create_manager' (cc662264-0ac6-45df-96ff-191c8688429b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:10 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ec69fccc-2552-45fd-b57d-ab8a1d888323 tempest-TestServerVolumeAttachmentScenario-821427881 None] Created volume successfully. Sep 29 16:40:10 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-7a33a417-4eac-431e-b361-b94b1f046629 req-3a82bbb6-8800-4695-a682-f42ead12626d tempest-AttachVolumeNegativeTest-2009311936 None] Terminate volume connection completed successfully. Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-7a33a417-4eac-431e-b361-b94b1f046629 req-3a82bbb6-8800-4695-a682-f42ead12626d tempest-AttachVolumeNegativeTest-2009311936 None] Deleting attachment 6b044a3f-bc83-44d2-9385-a804cf6374bf. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:40:10 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a835876e-14f0-442f-9ff8-295868f30983 1073741824" returned: 0 in 0.787s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a835876e-14f0-442f-9ff8-295868f30983 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:10 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a835876e-14f0-442f-9ff8-295868f30983 Sep 29 16:40:10 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:11 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a835876e-14f0-442f-9ff8-295868f30983" returned: 0 in 0.301s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:40:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7810878d-e604-40f4-951e-b64a679f5e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a835876e-14f0-442f-9ff8-295868f30983', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ab8e06-a556-4ff6-a64a-b0b8f2360db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:11 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Volume volume-a835876e-14f0-442f-9ff8-295868f30983 (a835876e-14f0-442f-9ff8-295868f30983): created successfully Sep 29 16:40:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ab8e06-a556-4ff6-a64a-b0b8f2360db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Flow 'volume_create_manager' (25fc0760-3b18-409a-85d5-4f58f795657a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:11 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-546c5959-69fe-4813-bdc6-0d879d6fce8b tempest-TestServerVolumeAttachmentScenario-821427881 None] Created volume successfully. Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Flow 'volume_create_manager' (567adfbb-8363-4b56-a875-65feb13a61c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c07a8f-a1c4-42bd-af5e-48ee5930da3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c07a8f-a1c4-42bd-af5e-48ee5930da3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-179562101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba68322-e26b-439f-99e4-6e101e4f4cfd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f7bb45d17884031be503ba21fdf820f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:13Z,use_quota=True,user_id='4cc20ee166d44c119afb6e34b97f9fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9557ea02-7c4b-46f1-ac10-1283a1404b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9557ea02-7c4b-46f1-ac10-1283a1404b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f09c2c-908e-450f-9516-8d80c2666ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f09c2c-908e-450f-9516-8d80c2666ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba68322-e26b-439f-99e4-6e101e4f4cfd', 'volume_name': 'volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10be1267-185f-4b23-8277-e68078f8e14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10be1267-185f-4b23-8277-e68078f8e14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f389898-decc-490f-bd26-6eda02fedbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:13 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Volume 9ba68322-e26b-439f-99e4-6e101e4f4cfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd', 'volume_size': 1} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-179562101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba68322-e26b-439f-99e4-6e101e4f4cfd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f7bb45d17884031be503ba21fdf820f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:13Z,use_quota=True,user_id='4cc20ee166d44c119afb6e34b97f9fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Creating volume 9ba68322-e26b-439f-99e4-6e101e4f4cfd {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:40:13 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:40:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:13 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd 1073741824 Sep 29 16:40:13 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:14 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd 1073741824" returned: 0 in 0.615s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:14 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd Sep 29 16:40:14 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:14 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd" returned: 0 in 0.466s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:40:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f389898-decc-490f-bd26-6eda02fedbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbc14ce-5b3f-4be7-8d21-5d6b89af8f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:14 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Volume volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd (9ba68322-e26b-439f-99e4-6e101e4f4cfd): created successfully Sep 29 16:40:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccbc14ce-5b3f-4be7-8d21-5d6b89af8f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Flow 'volume_create_manager' (567adfbb-8363-4b56-a875-65feb13a61c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:14 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b79901d9-4b28-4483-8e40-5b5c92e7403d tempest-VolumesGetTest-389233800 None] Created volume successfully. Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Flow 'volume_create_manager' (1c23b233-87ab-4897-89f2-8aca8a0ac956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89860b1d-eff1-48c7-863f-1af6b9b05e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89860b1d-eff1-48c7-863f-1af6b9b05e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1476037463',display_name='tempest-VolumesGetTest-Volume-316315316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9972e87c-5b1f-44ac-bee0-8cee2fd6a74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7bb45d17884031be503ba21fdf820f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:17Z,use_quota=True,user_id='4cc20ee166d44c119afb6e34b97f9fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2505025a-4faf-4793-8533-7cb2d643f4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2505025a-4faf-4793-8533-7cb2d643f4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579950ea-5288-4209-9fa3-373ee2194d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579950ea-5288-4209-9fa3-373ee2194d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9972e87c-5b1f-44ac-bee0-8cee2fd6a74e', 'volume_name': 'volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dba1655-eb1a-4b67-9c04-4d0236165c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dba1655-eb1a-4b67-9c04-4d0236165c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2a3a98-aa72-4ff0-8a6b-d9613aa5ba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:16 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Volume 9972e87c-5b1f-44ac-bee0-8cee2fd6a74e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e', 'volume_size': 1} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1476037463',display_name='tempest-VolumesGetTest-Volume-316315316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9972e87c-5b1f-44ac-bee0-8cee2fd6a74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7bb45d17884031be503ba21fdf820f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:17Z,use_quota=True,user_id='4cc20ee166d44c119afb6e34b97f9fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Creating volume 9972e87c-5b1f-44ac-bee0-8cee2fd6a74e {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:40:16 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:40:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:16 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e 1073741824 Sep 29 16:40:16 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:17 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e 1073741824" returned: 0 in 0.623s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:17 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e Sep 29 16:40:17 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:17 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e" returned: 0 in 0.323s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:40:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2a3a98-aa72-4ff0-8a6b-d9613aa5ba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed4ae0f-26d5-4dce-ace3-6461cf034f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:17 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Volume volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e (9972e87c-5b1f-44ac-bee0-8cee2fd6a74e): created successfully Sep 29 16:40:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ed4ae0f-26d5-4dce-ace3-6461cf034f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Flow 'volume_create_manager' (1c23b233-87ab-4897-89f2-8aca8a0ac956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:17 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-dfd65302-0983-4b3f-bc0e-f03bfa33d1c9 tempest-VolumesGetTest-389233800 None] Created volume successfully. Sep 29 16:40:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:40:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Lock "cinder-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:40:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-quobyte-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:40:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e" acquired by "delete_volume" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:40:19 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97e6289-f4dd-45b7-aa88-a9f8feb575a1]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:40:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:19 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e Sep 29 16:40:19 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:19 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e" returned: 0 in 0.453s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:19 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e Sep 29 16:40:19 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:19 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e" returned: 0 in 0.273s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:19 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e" released by "delete_volume" :: held 0.785s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:40:19 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Created reservations ['3bf912e9-4ace-46c8-a54f-3bf4cdb88e81', 'ac36ec77-aab1-46e7-bb0e-3be86c2a4b5b', 'bd56e033-ec4b-4d6b-896c-f7cf0988a3e7', 'fb003372-aa01-4840-8ac2-0a1e3a6ee0a7'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:40:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:40:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:40:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:19 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:40:19 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-9ba68322-e26b-439f-99e4-6e101e4f4cfd-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:40:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Lock "cinder-9ba68322-e26b-439f-99e4-6e101e4f4cfd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:40:20 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.355s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:20 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:40:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-quobyte-9ba68322-e26b-439f-99e4-6e101e4f4cfd" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:40:20 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Deleted volume successfully. Sep 29 16:40:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-9ba68322-e26b-439f-99e4-6e101e4f4cfd" acquired by "delete_volume" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:40:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78b66f5f-5074-4ff5-9651-e45d4458873f tempest-VolumesGetTest-389233800 None] Lock "cinder-9972e87c-5b1f-44ac-bee0-8cee2fd6a74e-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:40:20 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad21e0dc-4a22-4e36-a15c-249349a66e6a]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:40:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:20 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd Sep 29 16:40:20 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:20 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd" returned: 0 in 0.466s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:20 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd Sep 29 16:40:20 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:21 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ba68322-e26b-439f-99e4-6e101e4f4cfd" returned: 0 in 0.349s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-9ba68322-e26b-439f-99e4-6e101e4f4cfd" released by "delete_volume" :: held 0.892s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:40:21 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Created reservations ['14df79f9-ab93-4d4b-a507-3826768ada1b', 'e1a5272a-dcc6-48fa-9866-2223fd6f82e9', '6b4a0185-b59c-44b3-a36f-9884e5fd4b22', '1a61f0d4-6b5d-4916-a78e-908db2c1ee69'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:40:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:40:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:40:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:21 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:40:21 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:21 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.331s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:21 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:40:21 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Deleted volume successfully. Sep 29 16:40:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f257802a-394f-4177-aa87-a8807d876511 tempest-VolumesGetTest-389233800 None] Lock "cinder-9ba68322-e26b-439f-99e4-6e101e4f4cfd-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Flow 'volume_create_manager' (e87c9408-c5e4-403a-b3e9-f3321233482b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a0793d-a2af-4b16-9088-be738be8429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a0793d-a2af-4b16-9088-be738be8429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1801704909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1597ff74-bfe2-43bc-ad15-e54ad83d4e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7bb45d17884031be503ba21fdf820f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:24Z,use_quota=True,user_id='4cc20ee166d44c119afb6e34b97f9fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b77334e-df18-40a8-8ddc-c8d327d15266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b77334e-df18-40a8-8ddc-c8d327d15266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669d25d1-2019-4c18-901c-b821e9ddbb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (669d25d1-2019-4c18-901c-b821e9ddbb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1597ff74-bfe2-43bc-ad15-e54ad83d4e04', 'volume_name': 'volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04277ba-6c4f-4767-9828-fc56c3a3c61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f04277ba-6c4f-4767-9828-fc56c3a3c61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb1d220-af1a-45a1-a913-0314a6819d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:23 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Volume 1597ff74-bfe2-43bc-ad15-e54ad83d4e04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04', 'volume_size': 1} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1801704909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1597ff74-bfe2-43bc-ad15-e54ad83d4e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7bb45d17884031be503ba21fdf820f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:24Z,use_quota=True,user_id='4cc20ee166d44c119afb6e34b97f9fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Creating volume 1597ff74-bfe2-43bc-ad15-e54ad83d4e04 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:40:23 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:40:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:24 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 1073741824 Sep 29 16:40:24 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:24 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 1073741824" returned: 0 in 0.832s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:24 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 Sep 29 16:40:24 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:25 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04" returned: 0 in 0.337s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:40:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb1d220-af1a-45a1-a913-0314a6819d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e33bab-8967-4f97-b8df-148ce50c4fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:25 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Volume volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 (1597ff74-bfe2-43bc-ad15-e54ad83d4e04): created successfully Sep 29 16:40:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e33bab-8967-4f97-b8df-148ce50c4fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Flow 'volume_create_manager' (e87c9408-c5e4-403a-b3e9-f3321233482b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:25 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-34d01f99-0fd6-47b1-a25d-8d5923695155 tempest-VolumesGetTest-389233800 None] Created volume successfully. Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Flow 'volume_create_manager' (6ad2a7db-7669-4ab2-ac8f-8579bbb421f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290a986b-2116-4d30-9eb1-5f930b38be6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290a986b-2116-4d30-9eb1-5f930b38be6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2014895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39318be7-aa0e-4f65-b4dd-7ba10940cea2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f7bb45d17884031be503ba21fdf820f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1597ff74-bfe2-43bc-ad15-e54ad83d4e04,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:27Z,use_quota=True,user_id='4cc20ee166d44c119afb6e34b97f9fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2dd2657-17bc-47d5-a9ae-010f14f584c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2dd2657-17bc-47d5-a9ae-010f14f584c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526bd29f-3ac5-45bc-8e94-119251ebe9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526bd29f-3ac5-45bc-8e94-119251ebe9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '39318be7-aa0e-4f65-b4dd-7ba10940cea2', 'volume_name': 'volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2', 'volume_size': 1, 'source_volid': '1597ff74-bfe2-43bc-ad15-e54ad83d4e04', 'source_volstatus': 'available'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9021405-9a9a-4d86-bfa7-28cf6d46bb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9021405-9a9a-4d86-bfa7-28cf6d46bb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed71299-1bcf-44a7-9000-6ad117023057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:27 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Volume 39318be7-aa0e-4f65-b4dd-7ba10940cea2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2', 'volume_size': 1, 'source_volid': '1597ff74-bfe2-43bc-ad15-e54ad83d4e04', 'source_volstatus': 'available'} Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:27 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Cloning volume 1597ff74-bfe2-43bc-ad15-e54ad83d4e04 to volume 39318be7-aa0e-4f65-b4dd-7ba10940cea2 Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Creating offline snapshot db7a66b6-e263-4c5c-beb5-3dffc5e56f2d of volume 1597ff74-bfe2-43bc-ad15-e54ad83d4e04 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[187bde97-8c55-4c0e-ad67-8d64204ef6ff]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:40:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:27 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 Sep 29 16:40:27 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:28 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04" returned: 0 in 0.642s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:28 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d 1G Sep 29 16:40:28 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:29 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d 1G" returned: 0 in 0.788s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:29 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d Sep 29 16:40:29 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:29 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d" returned: 0 in 0.679s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:29 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d is being set with open permissions: ugo+rw Sep 29 16:40:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:29 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d Sep 29 16:40:29 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:30 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d" returned: 0 in 0.395s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:30 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.info Sep 29 16:40:30 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:30 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.info" returned: 0 in 0.520s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:30 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.info is being set with open permissions: ugo+rw Sep 29 16:40:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:30 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.info Sep 29 16:40:30 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:31 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.info" returned: 0 in 0.562s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-quobyte-39318be7-aa0e-4f65-b4dd-7ba10940cea2" by "_copy_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:40:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-39318be7-aa0e-4f65-b4dd-7ba10940cea2" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:40:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] snapshot: db7a66b6-e263-4c5c-beb5-3dffc5e56f2d, volume: 39318be7-aa0e-4f65-b4dd-7ba10940cea2, {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 16:40:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:40:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:40:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:31 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e6f488-2cdc-4f9f-b470-47c80cf39e6b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:40:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:31 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d Sep 29 16:40:31 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:32 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d" returned: 0 in 1.026s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:40:32 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c30010a-239e-4b2f-aca9-54e34c3b9026]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:40:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:32 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 Sep 29 16:40:32 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:33 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04" returned: 0 in 0.918s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] will copy from snapshot at /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 16:40:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Creating direct copy from snapshot {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 16:40:33 devstack cinder-volume[86793]: DEBUG cinder.utils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Path /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2 not found in is_blk_device check {{(pid=86793) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 16:40:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:33 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2 Sep 29 16:40:33 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:40:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:40:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:40:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:34 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:40:34 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:36 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 1.263s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:36 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:40:36 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:40:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:40:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:40:40 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=31,cinder:UPDATE=38,cinder:DELETE=5,cinder:INSERT=5 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:40:40 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=37,cinder:UPDATE=36,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:40:45 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2" returned: 0 in 11.777s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:45 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04, size 1024.00 MB, duration 11.78 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:40:45 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Converted 1024.00 MB image at 86.94 MB/s Sep 29 16:40:45 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2 is being set with open permissions: ugo+rw Sep 29 16:40:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:45 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2 Sep 29 16:40:45 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:45 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2" returned: 0 in 0.263s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-39318be7-aa0e-4f65-b4dd-7ba10940cea2" released by "_copy_volume_from_snapshot" :: held 14.181s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:40:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-quobyte-db7a66b6-e263-4c5c-beb5-3dffc5e56f2d" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:40:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-db7a66b6-e263-4c5c-beb5-3dffc5e56f2d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:40:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Deleting offline snapshot db7a66b6-e263-4c5c-beb5-3dffc5e56f2d of volume 1597ff74-bfe2-43bc-ad15-e54ad83d4e04 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:40:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] snapshot_file for this snap is: volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:40:45 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a3134d-1c92-4d66-8312-d2c87b2e2255]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:40:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:45 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d Sep 29 16:40:45 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:46 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d" returned: 0 in 0.623s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:40:46 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00807c5-c3fb-4ec9-a2b5-f7126f6d30f8]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:40:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:46 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 Sep 29 16:40:46 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:46 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04" returned: 0 in 0.619s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:46 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d Sep 29 16:40:46 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:47 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d" returned: 0 in 0.475s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:47 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d Sep 29 16:40:47 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:47 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04.db7a66b6-e263-4c5c-beb5-3dffc5e56f2d" returned: 0 in 0.361s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-db7a66b6-e263-4c5c-beb5-3dffc5e56f2d" released by "_delete_snapshot" :: held 2.206s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:40:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.413s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:47 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed71299-1bcf-44a7-9000-6ad117023057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2', 'volume_size': 1, 'source_volid': '1597ff74-bfe2-43bc-ad15-e54ad83d4e04', 'source_volstatus': 'available'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:47 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d42b0a1-0fb1-45df-9d9a-9e7cbab2b255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:47 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Volume volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2 (39318be7-aa0e-4f65-b4dd-7ba10940cea2): created successfully Sep 29 16:40:47 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d42b0a1-0fb1-45df-9d9a-9e7cbab2b255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:47 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Flow 'volume_create_manager' (6ad2a7db-7669-4ab2-ac8f-8579bbb421f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:47 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-db9a3596-adad-425c-8310-da8aef56e541 tempest-VolumesGetTest-389233800 None] Created volume successfully. Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Flow 'volume_create_manager' (f5f64d7a-8c4e-44c0-9227-1bbc80e9f698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d812f6-2082-492f-8bb7-8f9ea43467a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d812f6-2082-492f-8bb7-8f9ea43467a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1291789486',display_name='tempest-VolumesGetTest-Volume-365110077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9176761b-d81a-4301-a811-461bb46053f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7bb45d17884031be503ba21fdf820f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:49Z,use_quota=True,user_id='4cc20ee166d44c119afb6e34b97f9fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a44c421-2c7d-450e-be8b-e03a6819d66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a44c421-2c7d-450e-be8b-e03a6819d66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5d76fc-1663-4b8b-8ac3-710d6fd05f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5d76fc-1663-4b8b-8ac3-710d6fd05f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9176761b-d81a-4301-a811-461bb46053f3', 'volume_name': 'volume-9176761b-d81a-4301-a811-461bb46053f3', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba71be6-6937-406b-9a0a-dd78842f6d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba71be6-6937-406b-9a0a-dd78842f6d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8294ec-57b6-423c-9c62-74752c01b932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:49 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Volume 9176761b-d81a-4301-a811-461bb46053f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9176761b-d81a-4301-a811-461bb46053f3', 'volume_size': 1} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1291789486',display_name='tempest-VolumesGetTest-Volume-365110077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9176761b-d81a-4301-a811-461bb46053f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7bb45d17884031be503ba21fdf820f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:49Z,use_quota=True,user_id='4cc20ee166d44c119afb6e34b97f9fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Creating volume 9176761b-d81a-4301-a811-461bb46053f3 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:40:49 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:40:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9176761b-d81a-4301-a811-461bb46053f3 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:49 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9176761b-d81a-4301-a811-461bb46053f3 1073741824 Sep 29 16:40:49 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:50 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9176761b-d81a-4301-a811-461bb46053f3 1073741824" returned: 0 in 0.479s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9176761b-d81a-4301-a811-461bb46053f3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:50 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9176761b-d81a-4301-a811-461bb46053f3 Sep 29 16:40:50 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:50 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9176761b-d81a-4301-a811-461bb46053f3" returned: 0 in 0.249s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:40:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8294ec-57b6-423c-9c62-74752c01b932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9176761b-d81a-4301-a811-461bb46053f3', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e0585a-0d43-4771-b1c8-3d495ec5d45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:50 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Volume volume-9176761b-d81a-4301-a811-461bb46053f3 (9176761b-d81a-4301-a811-461bb46053f3): created successfully Sep 29 16:40:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e0585a-0d43-4771-b1c8-3d495ec5d45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Flow 'volume_create_manager' (f5f64d7a-8c4e-44c0-9227-1bbc80e9f698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:50 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-bdaa68c1-f2b2-4fb2-b5ff-26e7d8e3fcd1 tempest-VolumesGetTest-389233800 None] Created volume successfully. Sep 29 16:40:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-9176761b-d81a-4301-a811-461bb46053f3-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:40:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Lock "cinder-9176761b-d81a-4301-a811-461bb46053f3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:40:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-quobyte-9176761b-d81a-4301-a811-461bb46053f3" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:40:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-9176761b-d81a-4301-a811-461bb46053f3" acquired by "delete_volume" :: waited 0.021s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:40:51 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a332f7-764f-4b1a-a825-a0a028444ad5]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:40:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9176761b-d81a-4301-a811-461bb46053f3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:51 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9176761b-d81a-4301-a811-461bb46053f3 Sep 29 16:40:51 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:52 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9176761b-d81a-4301-a811-461bb46053f3" returned: 0 in 0.395s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9176761b-d81a-4301-a811-461bb46053f3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:52 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9176761b-d81a-4301-a811-461bb46053f3 Sep 29 16:40:52 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:52 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9176761b-d81a-4301-a811-461bb46053f3" returned: 0 in 0.281s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-9176761b-d81a-4301-a811-461bb46053f3" released by "delete_volume" :: held 0.727s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:40:52 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Created reservations ['9f0abdc9-1dfa-45cf-b16d-96b76b581f2d', 'fb701cc6-a3f6-4519-990f-1738ba7e8232', 'f3f5b8a1-4a46-416e-9d02-51f1165ce548', '17037cbb-39d6-4894-9f56-37db4146a26f'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:40:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:40:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:40:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:52 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:40:52 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:53 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.316s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:53 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:40:53 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Deleted volume successfully. Sep 29 16:40:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-39318be7-aa0e-4f65-b4dd-7ba10940cea2-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:40:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Lock "cinder-39318be7-aa0e-4f65-b4dd-7ba10940cea2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:40:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-94e1540f-4901-478b-bfa7-cbbf3916001b tempest-VolumesGetTest-389233800 None] Lock "cinder-9176761b-d81a-4301-a811-461bb46053f3-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:40:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-quobyte-39318be7-aa0e-4f65-b4dd-7ba10940cea2" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:40:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-39318be7-aa0e-4f65-b4dd-7ba10940cea2" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:40:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85366cf-84b2-4f1b-8cc5-6321f067a025]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:40:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:53 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2 Sep 29 16:40:53 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:53 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2" returned: 0 in 0.421s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:53 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2 Sep 29 16:40:53 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:53 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39318be7-aa0e-4f65-b4dd-7ba10940cea2" returned: 0 in 0.315s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-39318be7-aa0e-4f65-b4dd-7ba10940cea2" released by "delete_volume" :: held 0.796s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Created reservations ['ce44019e-1c16-4e40-9af7-621437c2cf55', '00630da8-88f5-4c0b-a786-c697c886c09c', '2eda63d2-27b7-45a4-9f9a-ca9df022c91e', 'ffaafe23-fee5-480d-95c2-b75c1e7bf41c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:54 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:40:54 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-a3be3728-1f2d-461e-8dae-b69ca7f806d0 req-895c2f4a-ec7e-40fe-b5f9-1c5e5c6ee2db tempest-TestServerVolumeAttachmentScenario-821427881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-a3be3728-1f2d-461e-8dae-b69ca7f806d0 req-895c2f4a-ec7e-40fe-b5f9-1c5e5c6ee2db tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-a3be3728-1f2d-461e-8dae-b69ca7f806d0 req-895c2f4a-ec7e-40fe-b5f9-1c5e5c6ee2db tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-1597ff74-bfe2-43bc-ad15-e54ad83d4e04-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:40:54 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.351s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Lock "cinder-1597ff74-bfe2-43bc-ad15-e54ad83d4e04-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-a3be3728-1f2d-461e-8dae-b69ca7f806d0 req-895c2f4a-ec7e-40fe-b5f9-1c5e5c6ee2db tempest-TestServerVolumeAttachmentScenario-821427881 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fef5071-ad77-4ae1-8d53-49bfa5e1adfd', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:40:54 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Deleted volume successfully. Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-quobyte-1597ff74-bfe2-43bc-ad15-e54ad83d4e04" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c398023e-46f3-4fe1-b862-37695f507106 tempest-VolumesGetTest-389233800 None] Lock "cinder-39318be7-aa0e-4f65-b4dd-7ba10940cea2-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-1597ff74-bfe2-43bc-ad15-e54ad83d4e04" acquired by "delete_volume" :: waited 0.036s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:40:54 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-a3be3728-1f2d-461e-8dae-b69ca7f806d0 req-895c2f4a-ec7e-40fe-b5f9-1c5e5c6ee2db tempest-TestServerVolumeAttachmentScenario-821427881 None] attachment_update completed successfully. Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50de9f6-51f8-4f1d-9d44-7a5c20c770b9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:40:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:54 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 Sep 29 16:40:54 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:55 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04" returned: 0 in 0.518s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:55 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04 Sep 29 16:40:55 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:55 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1597ff74-bfe2-43bc-ad15-e54ad83d4e04" returned: 0 in 0.664s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-1597ff74-bfe2-43bc-ad15-e54ad83d4e04" released by "delete_volume" :: held 1.315s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:40:56 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Created reservations ['34130d1e-ebb8-4538-9dd1-65cd2a85af2d', 'df80f65e-22f9-4cc9-b8b2-8eac57bea9a6', '1546a7e4-5734-453e-92d0-bd6da0c8746a', 'cf36b857-43dc-420e-afde-2ab1b8f6f726'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:40:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:40:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:40:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:40:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:40:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:40:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:56 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:40:56 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:56 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.477s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:56 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:40:56 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Deleted volume successfully. Sep 29 16:40:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3a5eec25-a697-45c9-adec-64166bfc1e76 tempest-VolumesGetTest-389233800 None] Lock "cinder-1597ff74-bfe2-43bc-ad15-e54ad83d4e04-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:40:57 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:40:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Flow 'volume_create_manager' (2043f878-067a-49b3-bdf0-836a1e1314c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:40:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa680dc-bf05-4942-9aac-8b5c88d3c623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa680dc-bf05-4942-9aac-8b5c88d3c623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-778870657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e7c839-db78-476d-aa7c-830a9e808246,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f7bb45d17884031be503ba21fdf820f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:58Z,use_quota=True,user_id='4cc20ee166d44c119afb6e34b97f9fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03aaa5b-d09e-40dd-a668-ce9197f1bed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03aaa5b-d09e-40dd-a668-ce9197f1bed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc6076e-315c-45bd-bc3e-0292ade06878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:57 devstack cinder-volume[86793]: DEBUG cinder.image.glance [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Creating Keystone auth plugin from conf {{(pid=86793) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 16:40:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc6076e-315c-45bd-bc3e-0292ade06878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '19e7c839-db78-476d-aa7c-830a9e808246', 'volume_name': 'volume-19e7c839-db78-476d-aa7c-830a9e808246', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd931a74-eab0-4339-9001-dacc66643a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd931a74-eab0-4339-9001-dacc66643a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:40:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfb6631-91d9-47bf-81c6-edb5ba645763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:40:58 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Volume 19e7c839-db78-476d-aa7c-830a9e808246: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-19e7c839-db78-476d-aa7c-830a9e808246', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 16:40:58 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Trying to clone 19e7c839-db78-476d-aa7c-830a9e808246 from image 041fad70-7851-4f49-af92-c1fc35c4c3b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]). {{(pid=86793) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 16:40:59 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_wnvyljjcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 16:40:59 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Image download 20.69 MB at 20.69 MB/s Sep 29 16:40:59 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4234792c-044b-420b-b06f-c3010f3908f2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:40:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_wnvyljjcdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:40:59 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_wnvyljjcdevstack@QuobyteHD Sep 29 16:40:59 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:40:59 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Sep 29 16:40:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_wnvyljjcdevstack@QuobyteHD" returned: 0 in 0.696s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:40:59 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Temporary image 041fad70-7851-4f49-af92-c1fc35c4c3b2 is fetched for user 4cc20ee166d44c119afb6e34b97f9fcc. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 16:40:59 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[10484f8a-1139-4b4f-9b99-f5128b2b2fa0]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:40:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_wnvyljjcdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:00 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_wnvyljjcdevstack@QuobyteHD Sep 29 16:41:00 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:00 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_wnvyljjcdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:40:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-778870657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e7c839-db78-476d-aa7c-830a9e808246,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7f7bb45d17884031be503ba21fdf820f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:40:58Z,use_quota=True,user_id='4cc20ee166d44c119afb6e34b97f9fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:41:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Creating volume 19e7c839-db78-476d-aa7c-830a9e808246 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:41:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:41:00 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:41:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:00 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 1073741824 Sep 29 16:41:00 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:00 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 1073741824" returned: 0 in 0.568s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:01 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 Sep 29 16:41:01 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:01 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246" returned: 0 in 0.326s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:41:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:01 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Attempting download of 041fad70-7851-4f49-af92-c1fc35c4c3b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}])) to volume 19e7c839-db78-476d-aa7c-830a9e808246. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 16:41:01 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae452628-7f34-4951-9ad6-bde8c9cb0dc5]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_qso0nbvh {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-962d53bc-309c-4b95-97da-3cf87b2c9644 req-9cef18fe-2d01-4dd0-bb34-d3612e63df18 tempest-TestServerVolumeAttachmentScenario-821427881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-962d53bc-309c-4b95-97da-3cf87b2c9644 req-9cef18fe-2d01-4dd0-bb34-d3612e63df18 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-962d53bc-309c-4b95-97da-3cf87b2c9644 req-9cef18fe-2d01-4dd0-bb34-d3612e63df18 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:01 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_qso0nbvh Sep 29 16:41:01 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-962d53bc-309c-4b95-97da-3cf87b2c9644 req-9cef18fe-2d01-4dd0-bb34-d3612e63df18 tempest-TestServerVolumeAttachmentScenario-821427881 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-a835876e-14f0-442f-9ff8-295868f30983', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b6418ec-7440-4a37-8b08-75d8704c4250', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:41:01 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-962d53bc-309c-4b95-97da-3cf87b2c9644 req-9cef18fe-2d01-4dd0-bb34-d3612e63df18 tempest-TestServerVolumeAttachmentScenario-821427881 None] attachment_update completed successfully. Sep 29 16:41:01 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_qso0nbvh" returned: 0 in 0.482s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_qso0nbvh {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:02 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_qso0nbvh Sep 29 16:41:02 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:02 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_qso0nbvh" returned: 1 in 0.376s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_qso0nbvh' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:41:02 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b729144-44d8-4b3a-909a-7219628454c6]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_wnvyljjcdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:02 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_wnvyljjcdevstack@QuobyteHD Sep 29 16:41:02 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:02 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_wnvyljjcdevstack@QuobyteHD" returned: 0 in 0.551s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:02 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] 041fad70-7851-4f49-af92-c1fc35c4c3b2 was qcow2, converting to qcow2 {{(pid=86793) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 16:41:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_wnvyljjcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:02 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_wnvyljjcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 Sep 29 16:41:02 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Flow 'volume_create_manager' (cd725d2d-c9af-4317-b825-185387241d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35dd5619-929e-43a8-898e-0a05494d2cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35dd5619-929e-43a8-898e-0a05494d2cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-23797740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f19cd7-cd5d-4669-a903-aac9e946a111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e63038847704d9f90bcbc9e5c3d6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:03Z,use_quota=True,user_id='8ac21cc147be44c8a02920121ab6c9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4075e2-0234-483d-b742-f0079b9e5eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4075e2-0234-483d-b742-f0079b9e5eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cd14ed-714a-40ef-83aa-20697f6d2724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cd14ed-714a-40ef-83aa-20697f6d2724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f19cd7-cd5d-4669-a903-aac9e946a111', 'volume_name': 'volume-77f19cd7-cd5d-4669-a903-aac9e946a111', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fcbb28-45c6-4c28-a17f-593c01985b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fcbb28-45c6-4c28-a17f-593c01985b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fae75d-901f-4775-8716-6e967e258cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:03 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Volume 77f19cd7-cd5d-4669-a903-aac9e946a111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f19cd7-cd5d-4669-a903-aac9e946a111', 'volume_size': 1} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-23797740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f19cd7-cd5d-4669-a903-aac9e946a111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e63038847704d9f90bcbc9e5c3d6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:03Z,use_quota=True,user_id='8ac21cc147be44c8a02920121ab6c9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Creating volume 77f19cd7-cd5d-4669-a903-aac9e946a111 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:41:03 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-77f19cd7-cd5d-4669-a903-aac9e946a111 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:03 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-77f19cd7-cd5d-4669-a903-aac9e946a111 1073741824 Sep 29 16:41:03 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Flow 'volume_create_manager' (43a5c413-6230-497c-8cf7-4bb93073bf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f313952c-5467-4871-a44a-d5af922fa3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f313952c-5467-4871-a44a-d5af922fa3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1482965185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb4c411-0d67-4d09-b1c9-16c99aee49b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d786a83201d1442c9e75f73b3820b78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:04Z,use_quota=True,user_id='871b5c15788e48a3962da7a471aff71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd37492-4435-477c-bb4c-4988b4efd590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd37492-4435-477c-bb4c-4988b4efd590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43315dba-1c7c-4074-87c8-2dfa7d472780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43315dba-1c7c-4074-87c8-2dfa7d472780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eb4c411-0d67-4d09-b1c9-16c99aee49b3', 'volume_name': 'volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af672b42-1286-4a4a-bb2e-bc4f3ad2bbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af672b42-1286-4a4a-bb2e-bc4f3ad2bbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185fffe6-097d-4906-b774-1347ab0803e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:03 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Volume 2eb4c411-0d67-4d09-b1c9-16c99aee49b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3', 'volume_size': 1} Sep 29 16:41:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:04 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-77f19cd7-cd5d-4669-a903-aac9e946a111 1073741824" returned: 0 in 0.710s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-77f19cd7-cd5d-4669-a903-aac9e946a111 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:04 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-77f19cd7-cd5d-4669-a903-aac9e946a111 Sep 29 16:41:04 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:04 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-77f19cd7-cd5d-4669-a903-aac9e946a111" returned: 0 in 0.451s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1482965185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb4c411-0d67-4d09-b1c9-16c99aee49b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d786a83201d1442c9e75f73b3820b78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:04Z,use_quota=True,user_id='871b5c15788e48a3962da7a471aff71f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Creating volume 2eb4c411-0d67-4d09-b1c9-16c99aee49b3 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:41:04 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:04 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3 1073741824 Sep 29 16:41:04 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fae75d-901f-4775-8716-6e967e258cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f19cd7-cd5d-4669-a903-aac9e946a111', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3a4153-8c33-4081-ab31-524a227a4afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:04 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Volume volume-77f19cd7-cd5d-4669-a903-aac9e946a111 (77f19cd7-cd5d-4669-a903-aac9e946a111): created successfully Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3a4153-8c33-4081-ab31-524a227a4afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Flow 'volume_create_manager' (cd725d2d-c9af-4317-b825-185387241d88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:04 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-af39fef6-1db9-44c8-b57e-e66b3578b422 tempest-VolumesActionsTest-993155934 None] Created volume successfully. Sep 29 16:41:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-213cdcb2-543e-40e7-b25d-bc5413609e35 req-a5201fb1-d108-49e7-8387-6b514c942aca tempest-TestServerVolumeAttachmentScenario-821427881 None] Terminate volume connection completed successfully. Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-213cdcb2-543e-40e7-b25d-bc5413609e35 req-a5201fb1-d108-49e7-8387-6b514c942aca tempest-TestServerVolumeAttachmentScenario-821427881 None] Deleting attachment 7b6418ec-7440-4a37-8b08-75d8704c4250. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:41:05 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3 1073741824" returned: 0 in 0.685s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:05 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3 Sep 29 16:41:05 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-00bf19eb-2739-45a1-8d1e-dca110c3c6d5 tempest-VolumesActionsTest-993155934 None] Acquiring lock "cinder-77f19cd7-cd5d-4669-a903-aac9e946a111" by "attach_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-00bf19eb-2739-45a1-8d1e-dca110c3c6d5 tempest-VolumesActionsTest-993155934 None] Lock "cinder-77f19cd7-cd5d-4669-a903-aac9e946a111" acquired by "attach_volume" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-00bf19eb-2739-45a1-8d1e-dca110c3c6d5 tempest-VolumesActionsTest-993155934 None] Attaching volume 77f19cd7-cd5d-4669-a903-aac9e946a111 to instance b5b8822c-2a79-486d-bc37-1df9ef21b9fa at mountpoint /dev/vdb on host None. Sep 29 16:41:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-00bf19eb-2739-45a1-8d1e-dca110c3c6d5 tempest-VolumesActionsTest-993155934 None] Attach volume completed successfully. Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-00bf19eb-2739-45a1-8d1e-dca110c3c6d5 tempest-VolumesActionsTest-993155934 None] Lock "cinder-77f19cd7-cd5d-4669-a903-aac9e946a111" released by "attach_volume" :: held 0.106s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:05 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3" returned: 0 in 0.492s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185fffe6-097d-4906-b774-1347ab0803e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:05 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65883f6-6972-4962-8109-a255df8d1a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_wnvyljjcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246" returned: 0 in 2.998s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_wnvyljjcdevstack@QuobyteHD, size 112.00 MB, duration 3.00 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:41:05 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Converted 112.00 MB image at 37.34 MB/s Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:05 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Volume volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3 (2eb4c411-0d67-4d09-b1c9-16c99aee49b3): created successfully Sep 29 16:41:05 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 1G Sep 29 16:41:05 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65883f6-6972-4962-8109-a255df8d1a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Flow 'volume_create_manager' (43a5c413-6230-497c-8cf7-4bb93073bf74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-20d7e21c-ecc4-422f-ab9d-4c9976a5a065 tempest-AttachVolumeNegativeTest-2009311936 None] Created volume successfully. Sep 29 16:41:06 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 1G" returned: 0 in 0.513s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Downloaded image 041fad70-7851-4f49-af92-c1fc35c4c3b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}])) to volume 19e7c839-db78-476d-aa7c-830a9e808246 successfully. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Temporary image 041fad70-7851-4f49-af92-c1fc35c4c3b2 for user 4cc20ee166d44c119afb6e34b97f9fcc is deleted. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Marking volume 19e7c839-db78-476d-aa7c-830a9e808246 as bootable. {{(pid=86793) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 16:41:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-024c6d19-2ed1-442d-944a-8540d5881c9f tempest-VolumesActionsTest-258074819 None] Terminate volume connection completed successfully. Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Copying metadata from image 041fad70-7851-4f49-af92-c1fc35c4c3b2 to 19e7c839-db78-476d-aa7c-830a9e808246. {{(pid=86793) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Creating volume glance metadata for volume 19e7c839-db78-476d-aa7c-830a9e808246 backed by image 041fad70-7851-4f49-af92-c1fc35c4c3b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86793) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-024c6d19-2ed1-442d-944a-8540d5881c9f tempest-VolumesActionsTest-258074819 None] Acquiring lock "cinder-77f19cd7-cd5d-4669-a903-aac9e946a111-detach_volume" by "detach_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-024c6d19-2ed1-442d-944a-8540d5881c9f tempest-VolumesActionsTest-258074819 None] Lock "cinder-77f19cd7-cd5d-4669-a903-aac9e946a111-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-024c6d19-2ed1-442d-944a-8540d5881c9f tempest-VolumesActionsTest-258074819 None] Detaching volume 77f19cd7-cd5d-4669-a903-aac9e946a111 from instance b5b8822c-2a79-486d-bc37-1df9ef21b9fa. Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfb6631-91d9-47bf-81c6-edb5ba645763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e7c839-db78-476d-aa7c-830a9e808246', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb0d40d-5ba5-415c-9bee-15abb2946302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:06 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Volume volume-19e7c839-db78-476d-aa7c-830a9e808246 (19e7c839-db78-476d-aa7c-830a9e808246): created successfully Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb0d40d-5ba5-415c-9bee-15abb2946302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Flow 'volume_create_manager' (2043f878-067a-49b3-bdf0-836a1e1314c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-024c6d19-2ed1-442d-944a-8540d5881c9f tempest-VolumesActionsTest-258074819 None] Detach volume completed successfully. Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-024c6d19-2ed1-442d-944a-8540d5881c9f tempest-VolumesActionsTest-258074819 None] Lock "cinder-77f19cd7-cd5d-4669-a903-aac9e946a111-detach_volume" released by "detach_volume" :: held 0.118s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4fb497d1-9430-4f7f-9799-b2fc3494c654 tempest-VolumesGetTest-389233800 None] Created volume successfully. Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a4fa953d-4077-4527-8c61-a42af6e57ca0 tempest-VolumesActionsTest-993155934 None] Acquiring lock "cinder-77f19cd7-cd5d-4669-a903-aac9e946a111-detach_volume" by "detach_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a4fa953d-4077-4527-8c61-a42af6e57ca0 tempest-VolumesActionsTest-993155934 None] Lock "cinder-77f19cd7-cd5d-4669-a903-aac9e946a111-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a4fa953d-4077-4527-8c61-a42af6e57ca0 tempest-VolumesActionsTest-993155934 None] Volume detach called, but volume not attached. Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a4fa953d-4077-4527-8c61-a42af6e57ca0 tempest-VolumesActionsTest-993155934 None] Lock "cinder-77f19cd7-cd5d-4669-a903-aac9e946a111-detach_volume" released by "detach_volume" :: held 0.018s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-bea42a78-02d2-473a-b99e-c9fd5cdd2024 req-34b1af54-c7d7-475e-a312-17fe16d27ad4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Terminate volume connection completed successfully. Sep 29 16:41:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-bea42a78-02d2-473a-b99e-c9fd5cdd2024 req-34b1af54-c7d7-475e-a312-17fe16d27ad4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Deleting attachment 8fef5071-ad77-4ae1-8d53-49bfa5e1adfd. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:41:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Acquiring lock "cinder-77f19cd7-cd5d-4669-a903-aac9e946a111-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Lock "cinder-77f19cd7-cd5d-4669-a903-aac9e946a111-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Acquiring lock "cinder-quobyte-77f19cd7-cd5d-4669-a903-aac9e946a111" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Lock "cinder-quobyte-77f19cd7-cd5d-4669-a903-aac9e946a111" acquired by "delete_volume" :: waited 0.034s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:07 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2604592-3fc7-40e5-aa5e-d64225115592]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-77f19cd7-cd5d-4669-a903-aac9e946a111 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:07 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-77f19cd7-cd5d-4669-a903-aac9e946a111 Sep 29 16:41:07 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:08 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-77f19cd7-cd5d-4669-a903-aac9e946a111" returned: 0 in 0.634s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-77f19cd7-cd5d-4669-a903-aac9e946a111 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:08 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-77f19cd7-cd5d-4669-a903-aac9e946a111 Sep 29 16:41:08 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-934fa8cb-f5e9-4cdf-b4db-617db909b410 req-cbfd8de7-6c06-453a-8e83-c08ac1d5aead tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-934fa8cb-f5e9-4cdf-b4db-617db909b410 req-cbfd8de7-6c06-453a-8e83-c08ac1d5aead tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-934fa8cb-f5e9-4cdf-b4db-617db909b410 req-cbfd8de7-6c06-453a-8e83-c08ac1d5aead tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-934fa8cb-f5e9-4cdf-b4db-617db909b410 req-cbfd8de7-6c06-453a-8e83-c08ac1d5aead tempest-AttachVolumeNegativeTest-2009311936 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09d5bdbc-d1eb-4683-b6ce-3a7e8823a435', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Flow 'volume_create_manager' (cff7b8a0-e306-4125-83fe-e9e495a8391c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03392d88-5d18-4a06-b063-dcbb4f333ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:08 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-77f19cd7-cd5d-4669-a903-aac9e946a111" returned: 0 in 0.633s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03392d88-5d18-4a06-b063-dcbb4f333ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1619188298',display_name='tempest-VolumesGetTest-Volume-458614067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7bb45d17884031be503ba21fdf820f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:09Z,use_quota=True,user_id='4cc20ee166d44c119afb6e34b97f9fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1066e3d9-d725-406f-b7e4-70078ed686d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1066e3d9-d725-406f-b7e4-70078ed686d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e467dc7-84b8-42d6-9b37-85987b29059e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e467dc7-84b8-42d6-9b37-85987b29059e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba', 'volume_name': 'volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d4b5bb-c129-4d42-a704-1a51cadff8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d4b5bb-c129-4d42-a704-1a51cadff8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3cee43-c8ad-4068-a848-4661b00841f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:08 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Volume fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba', 'volume_size': 1} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1619188298',display_name='tempest-VolumesGetTest-Volume-458614067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f7bb45d17884031be503ba21fdf820f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:09Z,use_quota=True,user_id='4cc20ee166d44c119afb6e34b97f9fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Creating volume fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:41:08 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:08 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Lock "cinder-quobyte-77f19cd7-cd5d-4669-a903-aac9e946a111" released by "delete_volume" :: held 1.489s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:08 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba 1073741824 Sep 29 16:41:08 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:09 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-934fa8cb-f5e9-4cdf-b4db-617db909b410 req-cbfd8de7-6c06-453a-8e83-c08ac1d5aead tempest-AttachVolumeNegativeTest-2009311936 None] attachment_update completed successfully. Sep 29 16:41:09 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Created reservations ['2dc8fb9f-a847-408a-9085-3227c95de156', '13943bda-3092-4d7b-8d84-ba787203c05a', 'f459a16b-c08e-4758-83ff-5727230039b1', '178c9cf3-5a59-42ed-a0f0-44cc39c539cc'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:41:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:09 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:09 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:09 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:09 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:09 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba 1073741824" returned: 0 in 0.859s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:10 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba Sep 29 16:41:10 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:10 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.760s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:10 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:10 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Deleted volume successfully. Sep 29 16:41:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1d1c08ef-5736-41f2-8220-82a03bb3c4c9 tempest-VolumesActionsTest-993155934 None] Lock "cinder-77f19cd7-cd5d-4669-a903-aac9e946a111-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:10 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba" returned: 0 in 0.610s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:41:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3cee43-c8ad-4068-a848-4661b00841f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aaa2a8a-430f-4276-9902-1826a6205d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:10 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Volume volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba (fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba): created successfully Sep 29 16:41:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aaa2a8a-430f-4276-9902-1826a6205d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Flow 'volume_create_manager' (cff7b8a0-e306-4125-83fe-e9e495a8391c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:10 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-8ae55ab8-da52-4365-9bd1-c2f68e535d6d tempest-VolumesGetTest-389233800 None] Created volume successfully. Sep 29 16:41:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Lock "cinder-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-quobyte-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:12 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1f58d9-8399-4543-bbad-02a6a221c151]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:12 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba Sep 29 16:41:12 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:12 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba" returned: 0 in 0.543s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:12 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba Sep 29 16:41:12 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:13 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-190a4bf9-02d0-472f-9bff-9a6e533345e4 req-b6b10f98-0a61-4d9a-8c8a-ed53b6a27a3f tempest-AttachVolumeNegativeTest-2009311936 None] Terminate volume connection completed successfully. Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-190a4bf9-02d0-472f-9bff-9a6e533345e4 req-b6b10f98-0a61-4d9a-8c8a-ed53b6a27a3f tempest-AttachVolumeNegativeTest-2009311936 None] Deleting attachment 09d5bdbc-d1eb-4683-b6ce-3a7e8823a435. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:41:13 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba" returned: 0 in 0.426s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba" released by "delete_volume" :: held 1.049s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Created reservations ['d405c1e1-d2dd-4560-a47a-fd4312005d54', '4475172c-7756-43cb-8d43-175385b8a494', '12c43aa4-211a-4120-91e2-72aa8663f867', 'b4de85c7-968e-4544-b3f1-0a60d7618bc3'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:13 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:13 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:13 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.410s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:13 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Deleted volume successfully. Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-298fa089-4e6a-4ea3-9953-d278ee70dc01 tempest-VolumesGetTest-389233800 None] Lock "cinder-fd97e1e3-64e7-4a73-b6af-d3b3bdd5ceba-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Acquiring lock "cinder-a835876e-14f0-442f-9ff8-295868f30983-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "cinder-a835876e-14f0-442f-9ff8-295868f30983-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Flow 'volume_create_manager' (7d68516f-7347-42f5-abc8-87386a1d765c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c6ba02-51ae-4abb-af5e-22978b0cae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c6ba02-51ae-4abb-af5e-22978b0cae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-691261436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d3fa92-1f77-47fa-b7ec-7a150e121536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e63038847704d9f90bcbc9e5c3d6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:14Z,use_quota=True,user_id='8ac21cc147be44c8a02920121ab6c9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c276e0-8534-4e64-9dcc-137d9293c225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c276e0-8534-4e64-9dcc-137d9293c225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef9da700-6723-489a-ba8b-e3637d1bee11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef9da700-6723-489a-ba8b-e3637d1bee11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d3fa92-1f77-47fa-b7ec-7a150e121536', 'volume_name': 'volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628c59b9-2ca3-4b34-b22d-999fdd7bc94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628c59b9-2ca3-4b34-b22d-999fdd7bc94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc888485-8b7e-42eb-b90e-4fa460ef03e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:14 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Volume d9d3fa92-1f77-47fa-b7ec-7a150e121536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536', 'volume_size': 1} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-691261436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d3fa92-1f77-47fa-b7ec-7a150e121536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e63038847704d9f90bcbc9e5c3d6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:14Z,use_quota=True,user_id='8ac21cc147be44c8a02920121ab6c9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Creating volume d9d3fa92-1f77-47fa-b7ec-7a150e121536 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:41:14 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:14 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536 1073741824 Sep 29 16:41:14 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Acquiring lock "cinder-quobyte-a835876e-14f0-442f-9ff8-295868f30983" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "cinder-quobyte-a835876e-14f0-442f-9ff8-295868f30983" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[129c1f27-6ba6-4bee-acd8-c33fa0c273db]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a835876e-14f0-442f-9ff8-295868f30983 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:14 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a835876e-14f0-442f-9ff8-295868f30983 Sep 29 16:41:14 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-19e7c839-db78-476d-aa7c-830a9e808246-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Lock "cinder-19e7c839-db78-476d-aa7c-830a9e808246-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Acquiring lock "cinder-quobyte-19e7c839-db78-476d-aa7c-830a9e808246" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-19e7c839-db78-476d-aa7c-830a9e808246" acquired by "delete_volume" :: waited 0.045s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77394ec-6f27-4c3e-ba5b-20152909d60a]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:14 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a835876e-14f0-442f-9ff8-295868f30983" returned: 0 in 0.665s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a835876e-14f0-442f-9ff8-295868f30983 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:14 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a835876e-14f0-442f-9ff8-295868f30983 Sep 29 16:41:14 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:14 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 Sep 29 16:41:14 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:14 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536 1073741824" returned: 0 in 0.867s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:14 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536 Sep 29 16:41:15 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:15 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a835876e-14f0-442f-9ff8-295868f30983" returned: 0 in 0.383s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "cinder-quobyte-a835876e-14f0-442f-9ff8-295868f30983" released by "delete_volume" :: held 1.111s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:15 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246" returned: 0 in 0.513s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:15 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246 Sep 29 16:41:15 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Created reservations ['ebb97457-ec42-4c32-8d50-03279b67ebb9', 'd3c9f42b-a2a9-4b45-ae87-68f079eb31d6', '29021e21-f0a7-4767-b0b3-29947944345d', '1f63005a-a32c-44c0-a579-0cb5285dc16b'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:41:15 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536" returned: 0 in 0.373s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc888485-8b7e-42eb-b90e-4fa460ef03e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24ed4d3-8aea-45a8-9dbf-5c6f329016cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:15 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Volume volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536 (d9d3fa92-1f77-47fa-b7ec-7a150e121536): created successfully Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24ed4d3-8aea-45a8-9dbf-5c6f329016cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Flow 'volume_create_manager' (7d68516f-7347-42f5-abc8-87386a1d765c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:15 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c5cce113-ddf1-4fe1-8ccb-50650582b39c tempest-VolumesActionsTest-993155934 None] Created volume successfully. Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:15 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:15 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:15 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19e7c839-db78-476d-aa7c-830a9e808246" returned: 0 in 0.336s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Lock "cinder-quobyte-19e7c839-db78-476d-aa7c-830a9e808246" released by "delete_volume" :: held 0.908s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Created reservations ['281d4cea-08b5-4412-89d6-dab0905cabde', '63681dee-0c48-43a4-9d00-6bedcb199bc3', '110f998e-33cd-4c1c-982b-3753be5f6fdf', '5e561d5d-bcd3-4544-88fd-9d1fe9d9eb34'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:15 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.296s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:15 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Deleted volume successfully. Sep 29 16:41:15 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:15 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee216891-1192-48d2-84be-56bbcaf742a4 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "cinder-a835876e-14f0-442f-9ff8-295868f30983-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:16 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.336s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:16 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Deleted volume successfully. Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-55c09d02-18ce-43d3-ad2d-c4d880ab0706 tempest-VolumesGetTest-389233800 None] Lock "cinder-19e7c839-db78-476d-aa7c-830a9e808246-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Acquiring lock "cinder-d9d3fa92-1f77-47fa-b7ec-7a150e121536-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Acquiring lock "cinder-4dfef36c-0bb6-47bb-b24e-f771a355fa2a-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Lock "cinder-d9d3fa92-1f77-47fa-b7ec-7a150e121536-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "cinder-4dfef36c-0bb6-47bb-b24e-f771a355fa2a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Acquiring lock "cinder-quobyte-d9d3fa92-1f77-47fa-b7ec-7a150e121536" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Acquiring lock "cinder-quobyte-4dfef36c-0bb6-47bb-b24e-f771a355fa2a" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Lock "cinder-quobyte-d9d3fa92-1f77-47fa-b7ec-7a150e121536" acquired by "delete_volume" :: waited 0.043s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "cinder-quobyte-4dfef36c-0bb6-47bb-b24e-f771a355fa2a" acquired by "delete_volume" :: waited 0.074s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b77513-3290-40f1-8ac4-b655a6d07c67]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[692a5c06-fae0-4d1b-a6b6-cfaf16a07861]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:16 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536 Sep 29 16:41:16 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:16 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a Sep 29 16:41:16 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:16 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536" returned: 0 in 0.475s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:16 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536 Sep 29 16:41:16 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:16 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a" returned: 0 in 0.515s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:17 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a Sep 29 16:41:17 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:17 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d9d3fa92-1f77-47fa-b7ec-7a150e121536" returned: 0 in 0.331s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Lock "cinder-quobyte-d9d3fa92-1f77-47fa-b7ec-7a150e121536" released by "delete_volume" :: held 0.907s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:17 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4dfef36c-0bb6-47bb-b24e-f771a355fa2a" returned: 0 in 0.303s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "cinder-quobyte-4dfef36c-0bb6-47bb-b24e-f771a355fa2a" released by "delete_volume" :: held 0.903s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Created reservations ['40ea581f-660b-4657-b1a6-6367e15319df', '3823fb3e-6ffa-4427-bac5-3e6aa36a599c', 'ba91e9bd-7471-4259-8d37-f0a8ab522c06', 'cbf5ef2a-02cd-4c13-b0c3-bc97749de67c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Created reservations ['eab94046-c117-4287-a309-3c6fb38191b0', '0aaea071-f355-4bcd-9448-36d4b34f37ec', 'e14c44ed-690a-490a-a2d0-fe05d790f74c', '6834989f-fc73-4dc0-818b-6d3724574e0c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:17 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:17 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:17 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:17 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:17 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:17 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.362s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.321s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:17 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Deleted volume successfully. Sep 29 16:41:17 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Deleted volume successfully. Sep 29 16:41:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0f94b822-4d1c-4f1b-895a-2b574804430d tempest-VolumesActionsTest-258074819 None] Lock "cinder-d9d3fa92-1f77-47fa-b7ec-7a150e121536-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1aa32e29-1cfd-40b1-b66a-de50a01ad483 tempest-TestServerVolumeAttachmentScenario-821427881 None] Lock "cinder-4dfef36c-0bb6-47bb-b24e-f771a355fa2a-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "cinder-2eb4c411-0d67-4d09-b1c9-16c99aee49b3-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "cinder-2eb4c411-0d67-4d09-b1c9-16c99aee49b3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "cinder-quobyte-2eb4c411-0d67-4d09-b1c9-16c99aee49b3" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "cinder-quobyte-2eb4c411-0d67-4d09-b1c9-16c99aee49b3" acquired by "delete_volume" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:18 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af0d299-a43c-40f2-aee5-37e5d152e53a]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:19 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3 Sep 29 16:41:19 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Flow 'volume_create_manager' (23582aa9-e117-4db6-bd60-f5d8e1e0a4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1351823d-b6d5-4ace-a325-341e659caa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1351823d-b6d5-4ace-a325-341e659caa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1972121119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d270d2-7d7d-4351-8691-82a055d1c309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e63038847704d9f90bcbc9e5c3d6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:19Z,use_quota=True,user_id='8ac21cc147be44c8a02920121ab6c9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d4773f-9d48-4087-94ee-e3101d862072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d4773f-9d48-4087-94ee-e3101d862072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185a4499-b3b3-44d3-816b-09f579d34e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185a4499-b3b3-44d3-816b-09f579d34e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d270d2-7d7d-4351-8691-82a055d1c309', 'volume_name': 'volume-39d270d2-7d7d-4351-8691-82a055d1c309', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56f78c7-ce67-4eff-807b-d929199e758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56f78c7-ce67-4eff-807b-d929199e758f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b57090-4c28-4d18-8490-a70e20fc8d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:19 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Volume 39d270d2-7d7d-4351-8691-82a055d1c309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d270d2-7d7d-4351-8691-82a055d1c309', 'volume_size': 1} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1972121119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d270d2-7d7d-4351-8691-82a055d1c309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e63038847704d9f90bcbc9e5c3d6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:19Z,use_quota=True,user_id='8ac21cc147be44c8a02920121ab6c9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Creating volume 39d270d2-7d7d-4351-8691-82a055d1c309 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:41:19 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39d270d2-7d7d-4351-8691-82a055d1c309 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:19 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3" returned: 0 in 0.535s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:19 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39d270d2-7d7d-4351-8691-82a055d1c309 1073741824 Sep 29 16:41:19 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:19 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3 Sep 29 16:41:19 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:19 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2eb4c411-0d67-4d09-b1c9-16c99aee49b3" returned: 0 in 0.348s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "cinder-quobyte-2eb4c411-0d67-4d09-b1c9-16c99aee49b3" released by "delete_volume" :: held 0.947s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Created reservations ['b1d6a079-8087-4750-8d59-ef3019ba1368', '89669263-8ef0-4827-81d4-483543ef7caa', '8e9d0394-6744-4cdf-8b97-2bfc1fce1a83', 'aa055bda-8bae-4c19-aeb8-948659f31feb'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:20 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:20 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:20 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39d270d2-7d7d-4351-8691-82a055d1c309 1073741824" returned: 0 in 0.669s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39d270d2-7d7d-4351-8691-82a055d1c309 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:20 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39d270d2-7d7d-4351-8691-82a055d1c309 Sep 29 16:41:20 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:20 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.316s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:20 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Deleted volume successfully. Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b87fd16-1b22-4b5e-9c55-9be263efdff0 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "cinder-2eb4c411-0d67-4d09-b1c9-16c99aee49b3-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:20 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39d270d2-7d7d-4351-8691-82a055d1c309" returned: 0 in 0.351s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b57090-4c28-4d18-8490-a70e20fc8d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d270d2-7d7d-4351-8691-82a055d1c309', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac994ed5-2f9b-4a41-811d-f202f3ded902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:20 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Volume volume-39d270d2-7d7d-4351-8691-82a055d1c309 (39d270d2-7d7d-4351-8691-82a055d1c309): created successfully Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac994ed5-2f9b-4a41-811d-f202f3ded902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Flow 'volume_create_manager' (23582aa9-e117-4db6-bd60-f5d8e1e0a4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:20 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e85a1ca7-8d44-4644-a3ad-3a7ba2efefd5 tempest-VolumesActionsTest-993155934 None] Created volume successfully. Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Flow 'volume_create_manager' (1022383c-7e70-413e-bf30-fe376ce4ea34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3c5675-e6f0-4bdb-b86c-2199da05189f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db3c5675-e6f0-4bdb-b86c-2199da05189f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-579062998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0660972-efa2-46e9-9624-beb4de1ea6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cb5bcbdc05468bb73c9c2491e4e5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:21Z,use_quota=True,user_id='c1389c2034204c71a0d93034e9fc305c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e55b2e8-6048-4c2e-9fcd-7ae6b8e970de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e55b2e8-6048-4c2e-9fcd-7ae6b8e970de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d81afd-d141-457b-97b1-27916f6e27e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d81afd-d141-457b-97b1-27916f6e27e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0660972-efa2-46e9-9624-beb4de1ea6df', 'volume_name': 'volume-a0660972-efa2-46e9-9624-beb4de1ea6df', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7b1216-f84a-4f80-a928-c132ee0b2151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c7b1216-f84a-4f80-a928-c132ee0b2151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a272f3ec-8db5-4fcd-be97-df98a2da1ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:20 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Volume a0660972-efa2-46e9-9624-beb4de1ea6df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0660972-efa2-46e9-9624-beb4de1ea6df', 'volume_size': 1} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-579062998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0660972-efa2-46e9-9624-beb4de1ea6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cb5bcbdc05468bb73c9c2491e4e5db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:21Z,use_quota=True,user_id='c1389c2034204c71a0d93034e9fc305c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Creating volume a0660972-efa2-46e9-9624-beb4de1ea6df {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:41:20 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:41:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a0660972-efa2-46e9-9624-beb4de1ea6df 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:20 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a0660972-efa2-46e9-9624-beb4de1ea6df 1073741824 Sep 29 16:41:20 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "cinder-1f3f814f-db14-49e4-bfad-d9f390c01924-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Lock "cinder-1f3f814f-db14-49e4-bfad-d9f390c01924-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "cinder-quobyte-1f3f814f-db14-49e4-bfad-d9f390c01924" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Lock "cinder-quobyte-1f3f814f-db14-49e4-bfad-d9f390c01924" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb31956-927c-44b5-b762-9d40482fd121]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1f3f814f-db14-49e4-bfad-d9f390c01924 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:21 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a0660972-efa2-46e9-9624-beb4de1ea6df 1073741824" returned: 0 in 0.556s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a0660972-efa2-46e9-9624-beb4de1ea6df {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:21 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a0660972-efa2-46e9-9624-beb4de1ea6df Sep 29 16:41:21 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:21 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1f3f814f-db14-49e4-bfad-d9f390c01924 Sep 29 16:41:21 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Acquiring lock "cinder-39d270d2-7d7d-4351-8691-82a055d1c309-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Lock "cinder-39d270d2-7d7d-4351-8691-82a055d1c309-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Acquiring lock "cinder-quobyte-39d270d2-7d7d-4351-8691-82a055d1c309" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:21 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a0660972-efa2-46e9-9624-beb4de1ea6df" returned: 0 in 0.417s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Lock "cinder-quobyte-39d270d2-7d7d-4351-8691-82a055d1c309" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:21 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a272f3ec-8db5-4fcd-be97-df98a2da1ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0660972-efa2-46e9-9624-beb4de1ea6df', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e23716c-7550-48bf-88c5-12336081e090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f14fa3-c683-40e4-b785-25665f1dea23]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39d270d2-7d7d-4351-8691-82a055d1c309 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1f3f814f-db14-49e4-bfad-d9f390c01924" returned: 0 in 0.610s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1f3f814f-db14-49e4-bfad-d9f390c01924 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:21 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Volume volume-a0660972-efa2-46e9-9624-beb4de1ea6df (a0660972-efa2-46e9-9624-beb4de1ea6df): created successfully Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e23716c-7550-48bf-88c5-12336081e090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Flow 'volume_create_manager' (1022383c-7e70-413e-bf30-fe376ce4ea34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:21 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1f3f814f-db14-49e4-bfad-d9f390c01924 Sep 29 16:41:21 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:21 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fdc7274b-8382-4059-8e78-41ff9f0bf1b3 tempest-VolumesNegativeTest-1026700130 None] Created volume successfully. Sep 29 16:41:21 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39d270d2-7d7d-4351-8691-82a055d1c309 Sep 29 16:41:21 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:22 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1f3f814f-db14-49e4-bfad-d9f390c01924" returned: 0 in 0.286s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Lock "cinder-quobyte-1f3f814f-db14-49e4-bfad-d9f390c01924" released by "delete_volume" :: held 0.953s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Created reservations ['90a5ea2b-0f3a-4a71-b321-1d4ad48e9e72', '5c45edfa-5a70-4353-b2d4-fda6b9cb12cf', 'ebbfc909-86b8-482a-b21d-0edbee8492bf', '0dd2a83b-72c5-488c-a6be-bd1a5a5a2036'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:41:22 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39d270d2-7d7d-4351-8691-82a055d1c309" returned: 0 in 0.387s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39d270d2-7d7d-4351-8691-82a055d1c309 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:22 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39d270d2-7d7d-4351-8691-82a055d1c309 Sep 29 16:41:22 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:22 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:22 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:22 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-39d270d2-7d7d-4351-8691-82a055d1c309" returned: 0 in 0.259s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Lock "cinder-quobyte-39d270d2-7d7d-4351-8691-82a055d1c309" released by "delete_volume" :: held 0.708s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Created reservations ['db1ff303-6739-4247-b5be-67043c02652f', '6c30a827-bd84-4bb8-9e5f-37a41c1b337d', '087da623-6263-4adb-a93f-5a83ba0bd8ff', '74a6f367-ef0e-4d34-90b7-bed5f0a967c9'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:41:22 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.296s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:22 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Deleted volume successfully. Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12322d60-27e1-417b-8dd8-43279843517a tempest-AttachVolumeNegativeTest-2009311936 None] Lock "cinder-1f3f814f-db14-49e4-bfad-d9f390c01924-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:22 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:22 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:23 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.315s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:23 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Deleted volume successfully. Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fdb8e1a7-9bce-4efe-b035-d550f5c04046 tempest-VolumesActionsTest-258074819 None] Lock "cinder-39d270d2-7d7d-4351-8691-82a055d1c309-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Flow 'volume_create_manager' (c8093fe2-9901-4a40-b3f3-00fab5b4b56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5d4dd7-31bc-454a-8b2c-4ed17ca75b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "cinder-ec6f8d0e-10f3-4c5c-b267-116c3253173d-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5d4dd7-31bc-454a-8b2c-4ed17ca75b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-572980098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32dd905-3f0b-4f68-acc6-354b68ece95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e63038847704d9f90bcbc9e5c3d6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:24Z,use_quota=True,user_id='8ac21cc147be44c8a02920121ab6c9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea7e595-f1a2-4dd8-be02-52f08204668c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea7e595-f1a2-4dd8-be02-52f08204668c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484f2f99-a80e-4101-aa0f-d1bc133515b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484f2f99-a80e-4101-aa0f-d1bc133515b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a32dd905-3f0b-4f68-acc6-354b68ece95a', 'volume_name': 'volume-a32dd905-3f0b-4f68-acc6-354b68ece95a', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (810c0b6d-8432-49ea-9e23-75ab575c7487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (810c0b6d-8432-49ea-9e23-75ab575c7487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178bad96-5feb-40fc-b0b3-6c5811317555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:23 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Volume a32dd905-3f0b-4f68-acc6-354b68ece95a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a32dd905-3f0b-4f68-acc6-354b68ece95a', 'volume_size': 1} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-572980098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32dd905-3f0b-4f68-acc6-354b68ece95a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e63038847704d9f90bcbc9e5c3d6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:24Z,use_quota=True,user_id='8ac21cc147be44c8a02920121ab6c9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Creating volume a32dd905-3f0b-4f68-acc6-354b68ece95a {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:41:23 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a32dd905-3f0b-4f68-acc6-354b68ece95a 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "cinder-ec6f8d0e-10f3-4c5c-b267-116c3253173d-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:23 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a32dd905-3f0b-4f68-acc6-354b68ece95a 1073741824 Sep 29 16:41:23 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "cinder-quobyte-ec6f8d0e-10f3-4c5c-b267-116c3253173d" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "cinder-quobyte-ec6f8d0e-10f3-4c5c-b267-116c3253173d" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bee130-9d9b-4968-b630-de90a775914b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:24 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d Sep 29 16:41:24 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:24 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a32dd905-3f0b-4f68-acc6-354b68ece95a 1073741824" returned: 0 in 0.730s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a32dd905-3f0b-4f68-acc6-354b68ece95a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:24 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d" returned: 0 in 0.664s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:24 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a32dd905-3f0b-4f68-acc6-354b68ece95a Sep 29 16:41:24 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:24 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d Sep 29 16:41:24 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:24 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a32dd905-3f0b-4f68-acc6-354b68ece95a" returned: 0 in 0.366s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:41:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178bad96-5feb-40fc-b0b3-6c5811317555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a32dd905-3f0b-4f68-acc6-354b68ece95a', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ae16c5-d828-4862-bdd0-333269cefa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:24 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ec6f8d0e-10f3-4c5c-b267-116c3253173d" returned: 0 in 0.367s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:25 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Volume volume-a32dd905-3f0b-4f68-acc6-354b68ece95a (a32dd905-3f0b-4f68-acc6-354b68ece95a): created successfully Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ae16c5-d828-4862-bdd0-333269cefa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Flow 'volume_create_manager' (c8093fe2-9901-4a40-b3f3-00fab5b4b56a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "cinder-quobyte-ec6f8d0e-10f3-4c5c-b267-116c3253173d" released by "delete_volume" :: held 1.118s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:25 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e36c0f99-3c18-4fa3-a809-a7731f69dd08 tempest-VolumesActionsTest-993155934 None] Created volume successfully. Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Created reservations ['4c363f92-aafd-4da4-850a-9f088127770a', '8653b90a-abe7-4d03-91ac-a5149c261968', 'e1546f63-7bc4-4fd6-aeca-ce90f6cfb12f', '82889fb9-bdbe-482e-9959-9fa6bafca7fe'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:25 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:25 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:25 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.276s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:25 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Deleted volume successfully. Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-bf9cd4e9-e6d7-482c-9a89-c0e66fb170a7 tempest-AttachVolumeNegativeTest-2009311936 None] Lock "cinder-ec6f8d0e-10f3-4c5c-b267-116c3253173d-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Acquiring lock "cinder-a32dd905-3f0b-4f68-acc6-354b68ece95a-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Lock "cinder-a32dd905-3f0b-4f68-acc6-354b68ece95a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Acquiring lock "cinder-quobyte-a32dd905-3f0b-4f68-acc6-354b68ece95a" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Lock "cinder-quobyte-a32dd905-3f0b-4f68-acc6-354b68ece95a" acquired by "delete_volume" :: waited 0.038s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:26 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a210d0-4459-4301-935f-80a59fa9c582]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a32dd905-3f0b-4f68-acc6-354b68ece95a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:26 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a32dd905-3f0b-4f68-acc6-354b68ece95a Sep 29 16:41:26 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:26 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a32dd905-3f0b-4f68-acc6-354b68ece95a" returned: 0 in 0.532s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a32dd905-3f0b-4f68-acc6-354b68ece95a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:26 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a32dd905-3f0b-4f68-acc6-354b68ece95a Sep 29 16:41:26 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:26 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a32dd905-3f0b-4f68-acc6-354b68ece95a" returned: 0 in 0.278s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Lock "cinder-quobyte-a32dd905-3f0b-4f68-acc6-354b68ece95a" released by "delete_volume" :: held 0.895s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:26 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Created reservations ['37e3e0f2-5359-42e7-8fab-68b2d18a46d2', 'e351d21b-5eec-4f6a-933e-b5b3c5e7bd1e', 'f9607e97-909b-431f-93b6-2150a8cfc341', '0a6ba464-1822-4159-ad82-7e88e1a0eb62'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:27 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:27 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:27 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.377s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:27 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Deleted volume successfully. Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f986c9d6-6f69-4794-a154-fe0bbc633101 tempest-VolumesActionsTest-258074819 None] Lock "cinder-a32dd905-3f0b-4f68-acc6-354b68ece95a-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Flow 'volume_create_manager' (5492c380-1ab5-4f4e-9e3b-38f5eb0e5a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f764b90c-28ce-4b8a-8809-798556863f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f764b90c-28ce-4b8a-8809-798556863f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31309924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c4abba-8222-4612-a6dc-44ae0f308092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e63038847704d9f90bcbc9e5c3d6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:28Z,use_quota=True,user_id='8ac21cc147be44c8a02920121ab6c9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4866dade-62dc-4bf6-a626-6ea5ce02183c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4866dade-62dc-4bf6-a626-6ea5ce02183c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7825b3-81b9-481f-ac3b-641eba33db6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7825b3-81b9-481f-ac3b-641eba33db6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86c4abba-8222-4612-a6dc-44ae0f308092', 'volume_name': 'volume-86c4abba-8222-4612-a6dc-44ae0f308092', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ddfe1e-4edc-4bc6-ba4b-d036d9ff3851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ddfe1e-4edc-4bc6-ba4b-d036d9ff3851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2344f868-d927-4c2d-b812-95df65529aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:27 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Volume 86c4abba-8222-4612-a6dc-44ae0f308092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86c4abba-8222-4612-a6dc-44ae0f308092', 'volume_size': 1} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31309924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c4abba-8222-4612-a6dc-44ae0f308092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e63038847704d9f90bcbc9e5c3d6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:28Z,use_quota=True,user_id='8ac21cc147be44c8a02920121ab6c9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Creating volume 86c4abba-8222-4612-a6dc-44ae0f308092 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:41:28 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:41:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-86c4abba-8222-4612-a6dc-44ae0f308092 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:28 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-86c4abba-8222-4612-a6dc-44ae0f308092 1073741824 Sep 29 16:41:28 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:28 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-86c4abba-8222-4612-a6dc-44ae0f308092 1073741824" returned: 0 in 0.553s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-86c4abba-8222-4612-a6dc-44ae0f308092 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:28 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-86c4abba-8222-4612-a6dc-44ae0f308092 Sep 29 16:41:28 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:28 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-86c4abba-8222-4612-a6dc-44ae0f308092" returned: 0 in 0.298s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:41:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2344f868-d927-4c2d-b812-95df65529aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c4abba-8222-4612-a6dc-44ae0f308092', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84f90ce-d0d8-433a-bbf8-dbe9a919825d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:28 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Volume volume-86c4abba-8222-4612-a6dc-44ae0f308092 (86c4abba-8222-4612-a6dc-44ae0f308092): created successfully Sep 29 16:41:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a84f90ce-d0d8-433a-bbf8-dbe9a919825d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Flow 'volume_create_manager' (5492c380-1ab5-4f4e-9e3b-38f5eb0e5a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:28 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ddd1bd7d-270b-4ba3-93db-3b67fda4ca1d tempest-VolumesActionsTest-993155934 None] Created volume successfully. Sep 29 16:41:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Acquiring lock "cinder-86c4abba-8222-4612-a6dc-44ae0f308092-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Lock "cinder-86c4abba-8222-4612-a6dc-44ae0f308092-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Acquiring lock "cinder-quobyte-86c4abba-8222-4612-a6dc-44ae0f308092" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Lock "cinder-quobyte-86c4abba-8222-4612-a6dc-44ae0f308092" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:30 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[434d612f-c885-46df-bfdb-2316bb421b6d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-86c4abba-8222-4612-a6dc-44ae0f308092 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:30 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-86c4abba-8222-4612-a6dc-44ae0f308092 Sep 29 16:41:30 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:30 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-86c4abba-8222-4612-a6dc-44ae0f308092" returned: 0 in 0.448s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-86c4abba-8222-4612-a6dc-44ae0f308092 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:30 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-86c4abba-8222-4612-a6dc-44ae0f308092 Sep 29 16:41:30 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:31 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-86c4abba-8222-4612-a6dc-44ae0f308092" returned: 0 in 0.278s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Lock "cinder-quobyte-86c4abba-8222-4612-a6dc-44ae0f308092" released by "delete_volume" :: held 0.799s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:31 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Created reservations ['09cfaeba-e89b-48ec-bd05-f88d7312d89f', '23c61cf6-8881-4540-8166-262107ebb1a9', '62d1e196-ea13-4268-a5bc-31e48cead594', 'e1d0dbe5-24c9-483c-a2b5-50e2e0990d00'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:41:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:31 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:31 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:31 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.372s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:31 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:31 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Deleted volume successfully. Sep 29 16:41:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0905e1ea-a145-49f5-a55d-0aac3aa79a90 tempest-VolumesActionsTest-258074819 None] Lock "cinder-86c4abba-8222-4612-a6dc-44ae0f308092-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Flow 'volume_create_manager' (4fa49d73-b24c-4f1a-bc6d-f77ad2bda332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64aa8f7b-7d9f-41fa-8768-5ff6f6685ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64aa8f7b-7d9f-41fa-8768-5ff6f6685ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1184173325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cce8f08-321f-4634-896b-d5f082b18013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e63038847704d9f90bcbc9e5c3d6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:32Z,use_quota=True,user_id='8ac21cc147be44c8a02920121ab6c9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb3a0c6-05e8-4ff1-a3e9-f72b4af77077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbb3a0c6-05e8-4ff1-a3e9-f72b4af77077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6614374-30de-4b17-9079-4147fb77e4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6614374-30de-4b17-9079-4147fb77e4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cce8f08-321f-4634-896b-d5f082b18013', 'volume_name': 'volume-6cce8f08-321f-4634-896b-d5f082b18013', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5928a3-2958-47b6-b1fd-a8270c11dbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5928a3-2958-47b6-b1fd-a8270c11dbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a1fafd-637f-44cd-821a-92b93603e9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:32 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Volume 6cce8f08-321f-4634-896b-d5f082b18013: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cce8f08-321f-4634-896b-d5f082b18013', 'volume_size': 1} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1184173325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cce8f08-321f-4634-896b-d5f082b18013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e63038847704d9f90bcbc9e5c3d6408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:41:32Z,use_quota=True,user_id='8ac21cc147be44c8a02920121ab6c9c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Creating volume 6cce8f08-321f-4634-896b-d5f082b18013 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:41:32 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:41:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6cce8f08-321f-4634-896b-d5f082b18013 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:32 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6cce8f08-321f-4634-896b-d5f082b18013 1073741824 Sep 29 16:41:32 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:33 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6cce8f08-321f-4634-896b-d5f082b18013 1073741824" returned: 0 in 0.983s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6cce8f08-321f-4634-896b-d5f082b18013 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:33 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6cce8f08-321f-4634-896b-d5f082b18013 Sep 29 16:41:33 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:33 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6cce8f08-321f-4634-896b-d5f082b18013" returned: 0 in 0.457s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:41:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a1fafd-637f-44cd-821a-92b93603e9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cce8f08-321f-4634-896b-d5f082b18013', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1759cd11-3794-46ba-883f-af47972e4a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:41:33 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Volume volume-6cce8f08-321f-4634-896b-d5f082b18013 (6cce8f08-321f-4634-896b-d5f082b18013): created successfully Sep 29 16:41:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1759cd11-3794-46ba-883f-af47972e4a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:41:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Flow 'volume_create_manager' (4fa49d73-b24c-4f1a-bc6d-f77ad2bda332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:41:33 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c65531cf-f259-4424-b03f-2fb1bc011c37 tempest-VolumesActionsTest-993155934 None] Created volume successfully. Sep 29 16:41:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:41:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:34 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:34 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:35 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Acquiring lock "cinder-6cce8f08-321f-4634-896b-d5f082b18013-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:35 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Lock "cinder-6cce8f08-321f-4634-896b-d5f082b18013-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:35 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Acquiring lock "cinder-quobyte-6cce8f08-321f-4634-896b-d5f082b18013" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:35 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Lock "cinder-quobyte-6cce8f08-321f-4634-896b-d5f082b18013" acquired by "delete_volume" :: waited 0.028s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:35 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[16604b64-ca8e-4b0e-9c3c-73ca090c6280]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6cce8f08-321f-4634-896b-d5f082b18013 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:35 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6cce8f08-321f-4634-896b-d5f082b18013 Sep 29 16:41:35 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:35 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.640s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:41:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:41:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:41:35 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6cce8f08-321f-4634-896b-d5f082b18013" returned: 0 in 0.587s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6cce8f08-321f-4634-896b-d5f082b18013 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:35 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6cce8f08-321f-4634-896b-d5f082b18013 Sep 29 16:41:35 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:36 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6cce8f08-321f-4634-896b-d5f082b18013" returned: 0 in 0.620s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Lock "cinder-quobyte-6cce8f08-321f-4634-896b-d5f082b18013" released by "delete_volume" :: held 1.286s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:36 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Created reservations ['b63af9be-9e7c-4727-94cf-caf51b458162', 'c8192a20-30cd-4022-b7fd-c4990d025ab8', '61df25fa-0d78-4795-af68-a6c72f312436', '95c251a3-c12b-4879-b25d-99592ca3b6d8'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:41:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:36 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:36 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:37 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.338s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:37 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:37 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Deleted volume successfully. Sep 29 16:41:37 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a4f9a2d9-ad3b-4849-8dd7-3bb4779ba009 tempest-VolumesActionsTest-993155934 None] Lock "cinder-6cce8f08-321f-4634-896b-d5f082b18013-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:46 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=175,cinder:SELECT=138,cinder:DELETE=13,cinder:INSERT=45 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:41:47 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=173,cinder:INSERT=46,cinder:SELECT=143,cinder:DELETE=15 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:41:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Acquiring lock "cinder-a0660972-efa2-46e9-9624-beb4de1ea6df-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Lock "cinder-a0660972-efa2-46e9-9624-beb4de1ea6df-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Acquiring lock "cinder-quobyte-a0660972-efa2-46e9-9624-beb4de1ea6df" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:41:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Lock "cinder-quobyte-a0660972-efa2-46e9-9624-beb4de1ea6df" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:41:55 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d6363d-c308-431b-8f61-7991788d35e5]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:41:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a0660972-efa2-46e9-9624-beb4de1ea6df {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:55 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a0660972-efa2-46e9-9624-beb4de1ea6df Sep 29 16:41:55 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:56 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a0660972-efa2-46e9-9624-beb4de1ea6df" returned: 0 in 0.531s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a0660972-efa2-46e9-9624-beb4de1ea6df {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:56 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a0660972-efa2-46e9-9624-beb4de1ea6df Sep 29 16:41:56 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:56 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a0660972-efa2-46e9-9624-beb4de1ea6df" returned: 0 in 0.341s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Lock "cinder-quobyte-a0660972-efa2-46e9-9624-beb4de1ea6df" released by "delete_volume" :: held 0.946s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:41:56 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Created reservations ['4c8e6413-de6d-4839-b7d7-885981b000f0', '73529e2a-edf1-4ab8-85f5-e7b5a306c04b', '475b3cb3-b60b-4fb0-a524-12b758875b72', '6e2b6c7b-b69b-4765-a90e-098a2f606d7d'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:41:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:41:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:41:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:41:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:41:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:41:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:41:56 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:41:56 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:41:57 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Sep 29 16:41:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.386s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:41:57 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:41:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Deleted volume successfully. Sep 29 16:41:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fe222649-214a-4a56-a2b2-b03f99878e5e tempest-VolumesNegativeTest-1026700130 None] Lock "cinder-a0660972-efa2-46e9-9624-beb4de1ea6df-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Flow 'volume_create_manager' (65901444-0942-4a25-bb9b-aa8ca0def4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e7beca-2dc5-45d8-be05-4cf02c25db79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e7beca-2dc5-45d8-be05-4cf02c25db79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1918861958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe4e57b-ca53-4623-a7b0-2ccf782f048f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f633f4aff514438dbd268f2de4b93a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:03Z,use_quota=True,user_id='95d3562643a14ecfb102eafe5ccfa439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab358d0-1a15-4200-80b5-c5d883ad1782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab358d0-1a15-4200-80b5-c5d883ad1782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0785d6-f65f-4f25-a6d0-93493bee5b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0785d6-f65f-4f25-a6d0-93493bee5b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfe4e57b-ca53-4623-a7b0-2ccf782f048f', 'volume_name': 'volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7735ca-bb6f-40d9-a456-1c8917d53922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7735ca-bb6f-40d9-a456-1c8917d53922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f386d9d-0996-49ba-ad34-978758632bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:02 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Volume dfe4e57b-ca53-4623-a7b0-2ccf782f048f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f', 'volume_size': 1} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1918861958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfe4e57b-ca53-4623-a7b0-2ccf782f048f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f633f4aff514438dbd268f2de4b93a8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:03Z,use_quota=True,user_id='95d3562643a14ecfb102eafe5ccfa439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Creating volume dfe4e57b-ca53-4623-a7b0-2ccf782f048f {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:02 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:42:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:02 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f 1073741824 Sep 29 16:42:02 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Flow 'volume_create_manager' (50cb0c7d-6200-40d9-a95b-4760d91484e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11455fe-ae5e-4559-859d-254918c57d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11455fe-ae5e-4559-859d-254918c57d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-937792106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f246808-4de1-4ada-a8dd-7de2cc6860f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09cc2b00600c4ef59f5a12785e7f5a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:03Z,use_quota=True,user_id='341585ffc02e4140b0018c4eb5a12bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48a0ebf-986a-41bf-991a-726c53525bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e48a0ebf-986a-41bf-991a-726c53525bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdad7ca7-bade-4881-b407-6f9e17fb473a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.image.glance [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Creating Keystone auth plugin from conf {{(pid=86793) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 16:42:03 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f 1073741824" returned: 0 in 0.676s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:03 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f Sep 29 16:42:03 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdad7ca7-bade-4881-b407-6f9e17fb473a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f246808-4de1-4ada-a8dd-7de2cc6860f7', 'volume_name': 'volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f04c365-8a52-43f9-a863-ddd4b74dddb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f04c365-8a52-43f9-a863-ddd4b74dddb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec2016a-cefc-4ffc-9594-7df233abc404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:03 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Volume 9f246808-4de1-4ada-a8dd-7de2cc6860f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Trying to clone 9f246808-4de1-4ada-a8dd-7de2cc6860f7 from image 041fad70-7851-4f49-af92-c1fc35c4c3b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]). {{(pid=86793) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 16:42:03 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f" returned: 0 in 0.371s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f386d9d-0996-49ba-ad34-978758632bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a12e4a-8787-4425-b8c9-b5561eef0a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:04 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Volume volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f (dfe4e57b-ca53-4623-a7b0-2ccf782f048f): created successfully Sep 29 16:42:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a12e4a-8787-4425-b8c9-b5561eef0a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Flow 'volume_create_manager' (65901444-0942-4a25-bb9b-aa8ca0def4eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:04 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-883d0913-3baf-4cdb-a5b4-c40c74ec60c5 tempest-VolumesServicesTestJSON-903637889 None] Created volume successfully. Sep 29 16:42:04 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2__j_zf571devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 16:42:04 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Image download 20.69 MB at 20.69 MB/s Sep 29 16:42:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[464fbb57-2e3b-49c0-bc5d-de487b732092]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2__j_zf571devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:04 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2__j_zf571devstack@QuobyteHD Sep 29 16:42:04 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:04 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2__j_zf571devstack@QuobyteHD" returned: 0 in 0.399s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:04 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Temporary image 041fad70-7851-4f49-af92-c1fc35c4c3b2 is fetched for user 341585ffc02e4140b0018c4eb5a12bf9. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 16:42:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f52ce7a-c17b-40c3-b517-50642fa2de63]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2__j_zf571devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Acquiring lock "cinder-dfe4e57b-ca53-4623-a7b0-2ccf782f048f-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:04 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2__j_zf571devstack@QuobyteHD Sep 29 16:42:04 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Lock "cinder-dfe4e57b-ca53-4623-a7b0-2ccf782f048f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Acquiring lock "cinder-quobyte-dfe4e57b-ca53-4623-a7b0-2ccf782f048f" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Lock "cinder-quobyte-dfe4e57b-ca53-4623-a7b0-2ccf782f048f" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed9ca21-9b75-4065-98a8-92c74a5ffd01]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:05 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2__j_zf571devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-937792106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f246808-4de1-4ada-a8dd-7de2cc6860f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09cc2b00600c4ef59f5a12785e7f5a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:03Z,use_quota=True,user_id='341585ffc02e4140b0018c4eb5a12bf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Creating volume 9f246808-4de1-4ada-a8dd-7de2cc6860f7 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:05 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:05 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 1073741824 Sep 29 16:42:05 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:05 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f Sep 29 16:42:05 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:05 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f" returned: 0 in 0.555s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:05 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f Sep 29 16:42:05 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:05 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 1073741824" returned: 0 in 0.580s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:05 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 Sep 29 16:42:05 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:05 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dfe4e57b-ca53-4623-a7b0-2ccf782f048f" returned: 0 in 0.315s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Lock "cinder-quobyte-dfe4e57b-ca53-4623-a7b0-2ccf782f048f" released by "delete_volume" :: held 0.971s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Created reservations ['01d1d3d4-6e6e-41b1-92d2-23a1f6304348', 'e883742e-3059-42d5-95b8-c46916331571', 'f3c8038d-9fd9-4b93-9c3e-cebc6273ad1f', 'dbb85f33-4fbc-44f4-b332-9358cb0e829a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:06 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7" returned: 0 in 0.408s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:06 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:42:06 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Attempting download of 041fad70-7851-4f49-af92-c1fc35c4c3b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}])) to volume 9f246808-4de1-4ada-a8dd-7de2cc6860f7. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2707d0f6-de1e-4b75-80cf-427ce724f03f]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_o8ezdzna {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:06 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_o8ezdzna Sep 29 16:42:06 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:06 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.412s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:42:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Deleted volume successfully. Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2712e1f2-ce9e-4b91-8c06-26d153c7f682 tempest-VolumesServicesTestJSON-903637889 None] Lock "cinder-dfe4e57b-ca53-4623-a7b0-2ccf782f048f-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:06 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_o8ezdzna" returned: 0 in 0.495s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_o8ezdzna {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:07 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_o8ezdzna Sep 29 16:42:07 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:07 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_o8ezdzna" returned: 1 in 0.372s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_o8ezdzna' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:42:07 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[463efcbd-522f-43b4-acfc-b10f0c0437e6]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2__j_zf571devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:07 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2__j_zf571devstack@QuobyteHD Sep 29 16:42:07 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:07 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2__j_zf571devstack@QuobyteHD" returned: 0 in 0.428s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:07 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] 041fad70-7851-4f49-af92-c1fc35c4c3b2 was qcow2, converting to qcow2 {{(pid=86793) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 16:42:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2__j_zf571devstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:07 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2__j_zf571devstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 Sep 29 16:42:07 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:10 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2__j_zf571devstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7" returned: 0 in 2.515s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:10 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2__j_zf571devstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:42:10 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Converted 112.00 MB image at 44.49 MB/s Sep 29 16:42:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:10 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 1G Sep 29 16:42:10 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:10 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 1G" returned: 0 in 0.445s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:10 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Downloaded image 041fad70-7851-4f49-af92-c1fc35c4c3b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}])) to volume 9f246808-4de1-4ada-a8dd-7de2cc6860f7 successfully. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 16:42:10 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Temporary image 041fad70-7851-4f49-af92-c1fc35c4c3b2 for user 341585ffc02e4140b0018c4eb5a12bf9 is deleted. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 16:42:10 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Marking volume 9f246808-4de1-4ada-a8dd-7de2cc6860f7 as bootable. {{(pid=86793) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 16:42:10 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Copying metadata from image 041fad70-7851-4f49-af92-c1fc35c4c3b2 to 9f246808-4de1-4ada-a8dd-7de2cc6860f7. {{(pid=86793) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 16:42:10 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Creating volume glance metadata for volume 9f246808-4de1-4ada-a8dd-7de2cc6860f7 backed by image 041fad70-7851-4f49-af92-c1fc35c4c3b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86793) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 16:42:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec2016a-cefc-4ffc-9594-7df233abc404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b854ff2-6183-408b-a733-82b12bc879ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:10 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Volume volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 (9f246808-4de1-4ada-a8dd-7de2cc6860f7): created successfully Sep 29 16:42:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b854ff2-6183-408b-a733-82b12bc879ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Flow 'volume_create_manager' (50cb0c7d-6200-40d9-a95b-4760d91484e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:10 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-63382431-8b5a-4cb3-8f2d-15b478cd0131 tempest-VolumesImageMetadata-1925435496 None] Created volume successfully. Sep 29 16:42:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Acquiring lock "cinder-9f246808-4de1-4ada-a8dd-7de2cc6860f7-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Lock "cinder-9f246808-4de1-4ada-a8dd-7de2cc6860f7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Acquiring lock "cinder-quobyte-9f246808-4de1-4ada-a8dd-7de2cc6860f7" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Lock "cinder-quobyte-9f246808-4de1-4ada-a8dd-7de2cc6860f7" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:12 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a909ac01-3306-4b4a-aba1-d5cd630be917]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:12 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 Sep 29 16:42:12 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:13 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7" returned: 0 in 0.498s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:13 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7 Sep 29 16:42:13 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:13 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9f246808-4de1-4ada-a8dd-7de2cc6860f7" returned: 0 in 0.372s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Lock "cinder-quobyte-9f246808-4de1-4ada-a8dd-7de2cc6860f7" released by "delete_volume" :: held 0.923s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:13 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Created reservations ['17b1a116-3aae-4bad-94d3-0fd5bdd6093b', 'ad91644e-cd0d-42bb-afbf-95be550b307d', 'efbd235c-20f2-45be-8325-71fea27e0f6f', '8e0932b2-90b1-4cad-9d1e-c5b4143ea377'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:42:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:14 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:42:14 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:14 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.334s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:14 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:42:14 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Deleted volume successfully. Sep 29 16:42:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e4221dff-4dfb-448c-89e0-8f6720da16e5 tempest-VolumesImageMetadata-1925435496 None] Lock "cinder-9f246808-4de1-4ada-a8dd-7de2cc6860f7-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Flow 'volume_create_manager' (18ff6155-beb1-4c14-b90a-338c01d84a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b75f5dd-cc46-4518-bae8-9e62a769a857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b75f5dd-cc46-4518-bae8-9e62a769a857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1578975791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4e2214-ce6b-4983-8fac-43437a3f2398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb509d13dcdb49a89c0a119792917d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:15Z,use_quota=True,user_id='edf98ef9a282463ea728327922233e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5019af8-4e5a-4d30-86e3-0c4eab434f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5019af8-4e5a-4d30-86e3-0c4eab434f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4139e39d-477d-4704-85b2-e5311ac891cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4139e39d-477d-4704-85b2-e5311ac891cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4e2214-ce6b-4983-8fac-43437a3f2398', 'volume_name': 'volume-de4e2214-ce6b-4983-8fac-43437a3f2398', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98d7d5f-a344-434d-8a46-e6678739371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98d7d5f-a344-434d-8a46-e6678739371e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e390a816-586d-460b-b1aa-5cdd9acf978f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:15 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Volume de4e2214-ce6b-4983-8fac-43437a3f2398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4e2214-ce6b-4983-8fac-43437a3f2398', 'volume_size': 1} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1578975791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4e2214-ce6b-4983-8fac-43437a3f2398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb509d13dcdb49a89c0a119792917d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:15Z,use_quota=True,user_id='edf98ef9a282463ea728327922233e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Creating volume de4e2214-ce6b-4983-8fac-43437a3f2398 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:15 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:42:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:15 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398 1073741824 Sep 29 16:42:15 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:16 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398 1073741824" returned: 0 in 0.601s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:16 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398 Sep 29 16:42:16 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:16 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398" returned: 0 in 0.440s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:42:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e390a816-586d-460b-b1aa-5cdd9acf978f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4e2214-ce6b-4983-8fac-43437a3f2398', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4a923a-c87b-42c5-82c4-049fc4febe4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:16 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Volume volume-de4e2214-ce6b-4983-8fac-43437a3f2398 (de4e2214-ce6b-4983-8fac-43437a3f2398): created successfully Sep 29 16:42:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d4a923a-c87b-42c5-82c4-049fc4febe4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Flow 'volume_create_manager' (18ff6155-beb1-4c14-b90a-338c01d84a29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:16 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-cb903cff-7cfa-41f3-b65c-e40bec98b210 tempest-VolumesSnapshotTestJSON-1962259830 None] Created volume successfully. Sep 29 16:42:17 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Flow 'volume_create_manager' (cb896523-ba6d-4ceb-bfbd-6a1ef4a5223f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b3ce94-884c-4084-8888-fb2ada2ba9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65b3ce94-884c-4084-8888-fb2ada2ba9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1962336966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=729f367e-9fe7-4c75-addb-aba35e056fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c2da99fbad4be790583f1a875ecd17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:18Z,use_quota=True,user_id='1b5169d271144ad0a15585454ecb567d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e31915-29e9-48d9-8b12-07eea6c52763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00e31915-29e9-48d9-8b12-07eea6c52763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7e72db-9bcd-4ccf-aee5-77e651741f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:17 devstack cinder-volume[86793]: DEBUG cinder.image.glance [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Creating Keystone auth plugin from conf {{(pid=86793) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 16:42:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:18 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] Creating offline snapshot 89155bf8-9b55-4888-9d8d-94ef7dc88437 of volume de4e2214-ce6b-4983-8fac-43437a3f2398 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:42:18 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1191da2-9817-47c4-a055-17a02ed69f4d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:18 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398 Sep 29 16:42:18 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:18 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7e72db-9bcd-4ccf-aee5-77e651741f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '729f367e-9fe7-4c75-addb-aba35e056fdd', 'volume_name': 'volume-729f367e-9fe7-4c75-addb-aba35e056fdd', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:18 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8960d6ef-9655-493c-87b6-73ecce7c1a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:18 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8960d6ef-9655-493c-87b6-73ecce7c1a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:18 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834eafee-371b-43c0-bfd8-36f7fe4c966a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:18 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Volume 729f367e-9fe7-4c75-addb-aba35e056fdd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-729f367e-9fe7-4c75-addb-aba35e056fdd', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 16:42:18 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Trying to clone 729f367e-9fe7-4c75-addb-aba35e056fdd from image 041fad70-7851-4f49-af92-c1fc35c4c3b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]). {{(pid=86793) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 16:42:18 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398" returned: 0 in 0.605s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:18 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 1G Sep 29 16:42:18 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:19 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_mx2tcj42devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 16:42:19 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Image download 20.69 MB at 20.69 MB/s Sep 29 16:42:19 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dc1ff3-84af-4ee4-b9b3-7e84b7d17878]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_mx2tcj42devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:19 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_mx2tcj42devstack@QuobyteHD Sep 29 16:42:19 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:19 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 1G" returned: 0 in 0.651s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4e2214-ce6b-4983-8fac-43437a3f2398 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:19 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4e2214-ce6b-4983-8fac-43437a3f2398 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 Sep 29 16:42:19 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:19 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_mx2tcj42devstack@QuobyteHD" returned: 0 in 0.482s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:19 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Temporary image 041fad70-7851-4f49-af92-c1fc35c4c3b2 is fetched for user 1b5169d271144ad0a15585454ecb567d. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 16:42:19 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4213ecf-df87-407c-a45d-df3813b4c231]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_mx2tcj42devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:19 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_mx2tcj42devstack@QuobyteHD Sep 29 16:42:19 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:19 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4e2214-ce6b-4983-8fac-43437a3f2398 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437" returned: 0 in 0.403s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:19 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 is being set with open permissions: ugo+rw Sep 29 16:42:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:19 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 Sep 29 16:42:19 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:20 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_mx2tcj42devstack@QuobyteHD" returned: 0 in 0.417s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:20 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437" returned: 0 in 0.319s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:20 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.info Sep 29 16:42:20 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:20 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.info" returned: 0 in 0.304s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:20 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.info is being set with open permissions: ugo+rw Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:20 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.info Sep 29 16:42:20 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:20 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.info" returned: 0 in 0.295s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1962336966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=729f367e-9fe7-4c75-addb-aba35e056fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6c2da99fbad4be790583f1a875ecd17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:18Z,use_quota=True,user_id='1b5169d271144ad0a15585454ecb567d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Creating volume 729f367e-9fe7-4c75-addb-aba35e056fdd {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:20 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:42:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:20 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd 1073741824 Sep 29 16:42:20 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:21 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7009df59-75ad-46f5-859f-8471304cb918 tempest-VolumesSnapshotTestJSON-1962259830 None] Create snapshot completed successfully Sep 29 16:42:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-89155bf8-9b55-4888-9d8d-94ef7dc88437-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:21 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd 1073741824" returned: 0 in 0.621s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-89155bf8-9b55-4888-9d8d-94ef7dc88437-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-de4e2214-ce6b-4983-8fac-43437a3f2398" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-de4e2214-ce6b-4983-8fac-43437a3f2398" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-89155bf8-9b55-4888-9d8d-94ef7dc88437" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:21 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd Sep 29 16:42:21 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-89155bf8-9b55-4888-9d8d-94ef7dc88437" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Deleting offline snapshot 89155bf8-9b55-4888-9d8d-94ef7dc88437 of volume de4e2214-ce6b-4983-8fac-43437a3f2398 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:42:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] snapshot_file for this snap is: volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:42:21 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8501185f-d792-472e-9280-f51a8bedfb09]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:21 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 Sep 29 16:42:21 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:21 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd" returned: 0 in 0.390s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Attempting download of 041fad70-7851-4f49-af92-c1fc35c4c3b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}])) to volume 729f367e-9fe7-4c75-addb-aba35e056fdd. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eff0b5-83fa-4dd9-8187-4b72eee867c4]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_zdkvfnit {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:22 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437" returned: 0 in 0.477s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de4e2214-ce6b-4983-8fac-43437a3f2398(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[58429e6d-4414-4531-88e6-1ef40177de8a]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:22 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_zdkvfnit Sep 29 16:42:22 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:22 devstack sudo[99798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398 Sep 29 16:42:22 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:22 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_zdkvfnit" returned: 0 in 0.370s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_zdkvfnit {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:22 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_zdkvfnit Sep 29 16:42:22 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:22 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398" returned: 0 in 0.441s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:22 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 Sep 29 16:42:22 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:22 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_zdkvfnit" returned: 1 in 0.399s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_zdkvfnit' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b167baf6-fc1f-4bb9-9bb4-def0fd589ad0]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_mx2tcj42devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:23 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_mx2tcj42devstack@QuobyteHD Sep 29 16:42:23 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:23 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437" returned: 0 in 0.488s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:23 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437 Sep 29 16:42:23 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:23 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Flow 'volume_create_manager' (3a6e0829-5776-4e31-a813-4326a1090978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa32653e-ea3f-460f-9c00-079b8966b216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_mx2tcj42devstack@QuobyteHD" returned: 0 in 0.513s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] 041fad70-7851-4f49-af92-c1fc35c4c3b2 was qcow2, converting to qcow2 {{(pid=86793) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_mx2tcj42devstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa32653e-ea3f-460f-9c00-079b8966b216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1912067511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba4c2e0-091f-4379-8278-1b50b7499fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc4d116446094e85bb62a90d2f1cabee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:23Z,use_quota=True,user_id='5023f5c3681048e4999066651f44b6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:23 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_mx2tcj42devstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f995cae-6efd-4e2d-8a91-e8f5b61ce9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:23 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f995cae-6efd-4e2d-8a91-e8f5b61ce9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1cfcaa-a648-4749-8257-c97e8d5ad391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1cfcaa-a648-4749-8257-c97e8d5ad391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aba4c2e0-091f-4379-8278-1b50b7499fc2', 'volume_name': 'volume-aba4c2e0-091f-4379-8278-1b50b7499fc2', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1668cf86-bcb3-40c0-9498-84dfc33b1bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1668cf86-bcb3-40c0-9498-84dfc33b1bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8ef3b4-7017-4770-aa98-84fc0268f3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:23 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Volume aba4c2e0-091f-4379-8278-1b50b7499fc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aba4c2e0-091f-4379-8278-1b50b7499fc2', 'volume_size': 1} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1912067511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba4c2e0-091f-4379-8278-1b50b7499fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc4d116446094e85bb62a90d2f1cabee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:23Z,use_quota=True,user_id='5023f5c3681048e4999066651f44b6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Creating volume aba4c2e0-091f-4379-8278-1b50b7499fc2 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:23 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-aba4c2e0-091f-4379-8278-1b50b7499fc2 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:23 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-aba4c2e0-091f-4379-8278-1b50b7499fc2 1073741824 Sep 29 16:42:23 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:23 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398.89155bf8-9b55-4888-9d8d-94ef7dc88437" returned: 0 in 0.422s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-89155bf8-9b55-4888-9d8d-94ef7dc88437" released by "_delete_snapshot" :: held 2.027s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-de4e2214-ce6b-4983-8fac-43437a3f2398" released by "delete_snapshot" :: held 2.059s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Created reservations ['c1c03082-f402-4651-803f-06bc857d09d7', 'd919b49f-be28-45ae-8f66-a11bca5521b9', 'e5c683d3-fcbf-41c3-a004-7e79cccadb4b', '71d7d3d2-d8e9-4aad-9b78-fae9415bcb99'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:42:23 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Delete snapshot completed successfully. Sep 29 16:42:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a54640-77d4-4ac8-b091-62d938c1e98a tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-89155bf8-9b55-4888-9d8d-94ef7dc88437-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:24 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-aba4c2e0-091f-4379-8278-1b50b7499fc2 1073741824" returned: 0 in 0.604s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-aba4c2e0-091f-4379-8278-1b50b7499fc2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:24 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-aba4c2e0-091f-4379-8278-1b50b7499fc2 Sep 29 16:42:24 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:24 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-aba4c2e0-091f-4379-8278-1b50b7499fc2" returned: 0 in 0.316s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:42:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c8ef3b4-7017-4770-aa98-84fc0268f3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aba4c2e0-091f-4379-8278-1b50b7499fc2', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7123a400-59ae-4ec3-8ee8-a5e74e062518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:24 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Volume volume-aba4c2e0-091f-4379-8278-1b50b7499fc2 (aba4c2e0-091f-4379-8278-1b50b7499fc2): created successfully Sep 29 16:42:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7123a400-59ae-4ec3-8ee8-a5e74e062518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Flow 'volume_create_manager' (3a6e0829-5776-4e31-a813-4326a1090978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:24 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e687e2ed-7513-472e-b535-e404062b4665 tempest-VolumesTransfersTest-1802360279 None] Created volume successfully. Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Flow 'volume_create_manager' (e4e9e68a-f798-494b-8fcd-0091b223247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23158432-0028-4b95-b15b-98eee8f95a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23158432-0028-4b95-b15b-98eee8f95a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-474328615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86bd45c-51cd-494e-bd43-b28a91b06eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb509d13dcdb49a89c0a119792917d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:25Z,use_quota=True,user_id='edf98ef9a282463ea728327922233e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6312a0f0-8808-404e-a736-91d8ad8d1aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6312a0f0-8808-404e-a736-91d8ad8d1aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c63c21-b301-4ca9-b13c-3dbe8707539e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c63c21-b301-4ca9-b13c-3dbe8707539e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a86bd45c-51cd-494e-bd43-b28a91b06eb0', 'volume_name': 'volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7322694-25bf-4bcc-af9f-1da727a2b4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7322694-25bf-4bcc-af9f-1da727a2b4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a6d54a-d557-4df5-a101-61d21eb2d6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:25 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Volume a86bd45c-51cd-494e-bd43-b28a91b06eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0', 'volume_size': 1} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-474328615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a86bd45c-51cd-494e-bd43-b28a91b06eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb509d13dcdb49a89c0a119792917d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:25Z,use_quota=True,user_id='edf98ef9a282463ea728327922233e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Creating volume a86bd45c-51cd-494e-bd43-b28a91b06eb0 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:25 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:25 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 1073741824 Sep 29 16:42:25 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:25 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_mx2tcj42devstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd" returned: 0 in 2.494s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_mx2tcj42devstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:42:25 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Converted 112.00 MB image at 44.89 MB/s Sep 29 16:42:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:25 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd 1G Sep 29 16:42:25 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Flow 'volume_create_manager' (418e141a-f5ab-4a64-9e66-6944bebdeddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad02bc2-493f-40a9-8c4c-e15f916441c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad02bc2-493f-40a9-8c4c-e15f916441c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-632657751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a16753-bd87-472a-b81e-df174034c50a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47c37f2fb73462ab5e2373744ce2f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:26Z,use_quota=True,user_id='aa208d4fee2748d4b0c63dfa699de82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d6c334-e190-430f-ad04-d7d5db007b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d6c334-e190-430f-ad04-d7d5db007b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ee8586-8140-4aed-af12-43dafca15be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59ee8586-8140-4aed-af12-43dafca15be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97a16753-bd87-472a-b81e-df174034c50a', 'volume_name': 'volume-97a16753-bd87-472a-b81e-df174034c50a', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7788798b-a58c-4ae5-b0bd-350023e66dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7788798b-a58c-4ae5-b0bd-350023e66dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cc47b9-a8f2-42b1-9977-6aec08870732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:26 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Volume 97a16753-bd87-472a-b81e-df174034c50a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97a16753-bd87-472a-b81e-df174034c50a', 'volume_size': 1} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:26 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 1073741824" returned: 0 in 0.545s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:26 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 Sep 29 16:42:26 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:26 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd 1G" returned: 0 in 0.376s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Downloaded image 041fad70-7851-4f49-af92-c1fc35c4c3b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}])) to volume 729f367e-9fe7-4c75-addb-aba35e056fdd successfully. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Temporary image 041fad70-7851-4f49-af92-c1fc35c4c3b2 for user 1b5169d271144ad0a15585454ecb567d is deleted. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Marking volume 729f367e-9fe7-4c75-addb-aba35e056fdd as bootable. {{(pid=86793) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Copying metadata from image 041fad70-7851-4f49-af92-c1fc35c4c3b2 to 729f367e-9fe7-4c75-addb-aba35e056fdd. {{(pid=86793) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Creating volume glance metadata for volume 729f367e-9fe7-4c75-addb-aba35e056fdd backed by image 041fad70-7851-4f49-af92-c1fc35c4c3b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86793) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834eafee-371b-43c0-bfd8-36f7fe4c966a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-729f367e-9fe7-4c75-addb-aba35e056fdd', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05ae516-575b-48fe-946c-769a39f704ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:26 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Volume volume-729f367e-9fe7-4c75-addb-aba35e056fdd (729f367e-9fe7-4c75-addb-aba35e056fdd): created successfully Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05ae516-575b-48fe-946c-769a39f704ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Flow 'volume_create_manager' (cb896523-ba6d-4ceb-bfbd-6a1ef4a5223f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:26 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a47b5686-2d38-4891-ac4f-0150a696e1e2 tempest-TestShelveInstance-189878563 None] Created volume successfully. Sep 29 16:42:26 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fe28789c-7886-4839-ac07-bcacbf9330b9 tempest-VolumesTransfersTest-294783456 None] Transfer volume completed successfully. Sep 29 16:42:26 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0" returned: 0 in 0.313s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.409s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-632657751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a16753-bd87-472a-b81e-df174034c50a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47c37f2fb73462ab5e2373744ce2f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:26Z,use_quota=True,user_id='aa208d4fee2748d4b0c63dfa699de82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Creating volume 97a16753-bd87-472a-b81e-df174034c50a {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:26 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-97a16753-bd87-472a-b81e-df174034c50a 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:26 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-97a16753-bd87-472a-b81e-df174034c50a 1073741824 Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a6d54a-d557-4df5-a101-61d21eb2d6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:26 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc2d553-63ff-45aa-b124-8238dce43329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:26 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Volume volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 (a86bd45c-51cd-494e-bd43-b28a91b06eb0): created successfully Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc2d553-63ff-45aa-b124-8238dce43329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Flow 'volume_create_manager' (e4e9e68a-f798-494b-8fcd-0091b223247d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:26 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4fdf2d22-f4a9-4680-a4cf-7b2752b623cc tempest-VolumesSnapshotTestJSON-1962259830 None] Created volume successfully. Sep 29 16:42:27 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-97a16753-bd87-472a-b81e-df174034c50a 1073741824" returned: 0 in 0.470s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Acquiring lock "cinder-aba4c2e0-091f-4379-8278-1b50b7499fc2-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Lock "cinder-aba4c2e0-091f-4379-8278-1b50b7499fc2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-97a16753-bd87-472a-b81e-df174034c50a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:27 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-97a16753-bd87-472a-b81e-df174034c50a Sep 29 16:42:27 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Acquiring lock "cinder-quobyte-aba4c2e0-091f-4379-8278-1b50b7499fc2" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Lock "cinder-quobyte-aba4c2e0-091f-4379-8278-1b50b7499fc2" acquired by "delete_volume" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d315f1-655c-410a-b91a-04a3e3deee17]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-aba4c2e0-091f-4379-8278-1b50b7499fc2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:27 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-aba4c2e0-091f-4379-8278-1b50b7499fc2 Sep 29 16:42:27 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:27 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-97a16753-bd87-472a-b81e-df174034c50a" returned: 0 in 0.253s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cc47b9-a8f2-42b1-9977-6aec08870732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97a16753-bd87-472a-b81e-df174034c50a', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6e62e2-5081-4a45-96d1-2aad1d51c657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:27 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Volume volume-97a16753-bd87-472a-b81e-df174034c50a (97a16753-bd87-472a-b81e-df174034c50a): created successfully Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6e62e2-5081-4a45-96d1-2aad1d51c657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Flow 'volume_create_manager' (418e141a-f5ab-4a64-9e66-6944bebdeddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:27 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b19f161a-0bef-473c-ac2a-c8f7408be9fb tempest-VolumesListAdminTestJSON-1533318943 None] Created volume successfully. Sep 29 16:42:27 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-aba4c2e0-091f-4379-8278-1b50b7499fc2" returned: 0 in 0.382s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-aba4c2e0-091f-4379-8278-1b50b7499fc2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:27 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-aba4c2e0-091f-4379-8278-1b50b7499fc2 Sep 29 16:42:27 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:27 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-aba4c2e0-091f-4379-8278-1b50b7499fc2" returned: 0 in 0.279s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] Creating offline snapshot 0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 of volume a86bd45c-51cd-494e-bd43-b28a91b06eb0 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Lock "cinder-quobyte-aba4c2e0-091f-4379-8278-1b50b7499fc2" released by "delete_volume" :: held 0.719s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc65d46-6aac-4568-bb35-9cec03dfe156]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:27 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Created reservations ['0caf44b8-2f74-4431-bd1c-4725a438451e', '23608be5-3d62-47b8-ad1b-5755feb42379', '942f68b5-c96a-46b8-9fbc-c3d2037db2a8', '25a91223-1fba-46ad-9d2d-569ead40d5de'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:28 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 Sep 29 16:42:28 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:28 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:42:28 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:28 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0" returned: 0 in 0.453s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:28 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.339s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:42:28 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Deleted volume successfully. Sep 29 16:42:28 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 1G Sep 29 16:42:28 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2539632a-2949-4646-93ef-2e56173cae03 tempest-VolumesTransfersTest-1137653364 None] Lock "cinder-aba4c2e0-091f-4379-8278-1b50b7499fc2-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Flow 'volume_create_manager' (29f08e4c-4655-4c3b-83e3-777a6f8b2b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d831fec7-d620-4eb4-ae36-cd8fe1ce091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d831fec7-d620-4eb4-ae36-cd8fe1ce091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1141154965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f25ad3-30b4-4eca-a543-f26ee3a7d085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47c37f2fb73462ab5e2373744ce2f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:29Z,use_quota=True,user_id='aa208d4fee2748d4b0c63dfa699de82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb60ddab-e1b9-49e4-ae88-e9343b2499a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb60ddab-e1b9-49e4-ae88-e9343b2499a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad30d13-f173-4247-bbd1-2172a29e6472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad30d13-f173-4247-bbd1-2172a29e6472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47f25ad3-30b4-4eca-a543-f26ee3a7d085', 'volume_name': 'volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1dd1fa8-a0d6-4101-9b4d-5eb74cca2cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1dd1fa8-a0d6-4101-9b4d-5eb74cca2cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3b2b12-3811-48aa-aea1-be422b965473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:28 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Volume 47f25ad3-30b4-4eca-a543-f26ee3a7d085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085', 'volume_size': 1} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:28 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 1G" returned: 0 in 0.603s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:28 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 Sep 29 16:42:28 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Flow 'volume_create_manager' (bf95b9ff-c6f6-409e-af84-4b84bb4c3126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312d2030-4411-4e87-8178-adcd9d87e3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312d2030-4411-4e87-8178-adcd9d87e3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-742577860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6867dad2-d135-4a90-ae0f-1e7213173555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc4d116446094e85bb62a90d2f1cabee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:29Z,use_quota=True,user_id='5023f5c3681048e4999066651f44b6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7db62d-858f-48eb-81e3-7b425d72b888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7db62d-858f-48eb-81e3-7b425d72b888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a5530b-eacb-4daf-97a4-fbe8c30d8669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a5530b-eacb-4daf-97a4-fbe8c30d8669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6867dad2-d135-4a90-ae0f-1e7213173555', 'volume_name': 'volume-6867dad2-d135-4a90-ae0f-1e7213173555', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f286bf63-7af6-482c-94be-f661848aaa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f286bf63-7af6-482c-94be-f661848aaa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d09625b-a8d6-4550-a9d4-17596c094bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:29 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Volume 6867dad2-d135-4a90-ae0f-1e7213173555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6867dad2-d135-4a90-ae0f-1e7213173555', 'volume_size': 1} Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:29 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8" returned: 0 in 0.357s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:29 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 is being set with open permissions: ugo+rw Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:29 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 Sep 29 16:42:29 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:29 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8" returned: 0 in 0.283s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:29 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.info Sep 29 16:42:29 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:29 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.info" returned: 0 in 0.285s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:29 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.info is being set with open permissions: ugo+rw Sep 29 16:42:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:29 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.info Sep 29 16:42:29 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:30 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.info" returned: 0 in 0.295s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.312s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1141154965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f25ad3-30b4-4eca-a543-f26ee3a7d085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47c37f2fb73462ab5e2373744ce2f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:29Z,use_quota=True,user_id='aa208d4fee2748d4b0c63dfa699de82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Creating volume 47f25ad3-30b4-4eca-a543-f26ee3a7d085 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:30 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:30 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085 1073741824 Sep 29 16:42:30 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:30 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-87b9f98e-03c1-4e53-b974-65f07b374ff6 tempest-VolumesSnapshotTestJSON-1962259830 None] Create snapshot completed successfully Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-f7f7406d-4dcd-48f3-bfb3-2facf2a0d177 req-6d420e87-eac6-4bae-8679-8da28b9a973e tempest-TestShelveInstance-189878563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:30 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085 1073741824" returned: 0 in 0.544s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:30 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085 Sep 29 16:42:30 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:31 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085" returned: 0 in 0.336s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.049s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-742577860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6867dad2-d135-4a90-ae0f-1e7213173555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc4d116446094e85bb62a90d2f1cabee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:29Z,use_quota=True,user_id='5023f5c3681048e4999066651f44b6cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Creating volume 6867dad2-d135-4a90-ae0f-1e7213173555 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:31 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6867dad2-d135-4a90-ae0f-1e7213173555 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3b2b12-3811-48aa-aea1-be422b965473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:31 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6867dad2-d135-4a90-ae0f-1e7213173555 1073741824 Sep 29 16:42:31 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af2429c-04fd-4693-a41f-5ebe74d0f884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:31 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Volume volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085 (47f25ad3-30b4-4eca-a543-f26ee3a7d085): created successfully Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af2429c-04fd-4693-a41f-5ebe74d0f884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Flow 'volume_create_manager' (29f08e4c-4655-4c3b-83e3-777a6f8b2b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:31 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a0a58061-047d-4676-b783-6a424f52921b tempest-VolumesListAdminTestJSON-1533318943 None] Created volume successfully. Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:31 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Flow 'volume_create_manager' (7bbd097b-186b-470c-89e9-cf59e0e8382c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7053a0-5696-46c2-9a6c-522dd9f817df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6867dad2-d135-4a90-ae0f-1e7213173555 1073741824" returned: 0 in 0.666s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7053a0-5696-46c2-9a6c-522dd9f817df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-495972229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47573b9-a11c-4e68-a941-d39c9a3f17c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb509d13dcdb49a89c0a119792917d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:32Z,use_quota=True,user_id='edf98ef9a282463ea728327922233e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71cf8e8-2d03-4cc0-80dd-832f8e072c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71cf8e8-2d03-4cc0-80dd-832f8e072c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17beb8e-e81c-42de-ba05-8e1d7725c1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17beb8e-e81c-42de-ba05-8e1d7725c1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a47573b9-a11c-4e68-a941-d39c9a3f17c3', 'volume_name': 'volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3', 'volume_size': 2, 'snapshot_id': '0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d663cf9-12e9-4a7b-96ca-4ddbc20cb5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d663cf9-12e9-4a7b-96ca-4ddbc20cb5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22a5eff-1f51-47c0-9987-b8f9647d4418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:31 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Volume a47573b9-a11c-4e68-a941-d39c9a3f17c3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3', 'volume_size': 2, 'snapshot_id': '0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8'} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6867dad2-d135-4a90-ae0f-1e7213173555 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:31 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6867dad2-d135-4a90-ae0f-1e7213173555 Sep 29 16:42:31 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:32 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6867dad2-d135-4a90-ae0f-1e7213173555" returned: 0 in 0.281s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-f7f7406d-4dcd-48f3-bfb3-2facf2a0d177 req-6d420e87-eac6-4bae-8679-8da28b9a973e tempest-TestShelveInstance-189878563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.588s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-f7f7406d-4dcd-48f3-bfb3-2facf2a0d177 req-6d420e87-eac6-4bae-8679-8da28b9a973e tempest-TestShelveInstance-189878563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.321s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8-a47573b9-a11c-4e68-a941-d39c9a3f17c3" by "_create_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d09625b-a8d6-4550-a9d4-17596c094bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6867dad2-d135-4a90-ae0f-1e7213173555', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e248318-5f31-426e-9dd9-c1a58f88983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:32 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Volume volume-6867dad2-d135-4a90-ae0f-1e7213173555 (6867dad2-d135-4a90-ae0f-1e7213173555): created successfully Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e248318-5f31-426e-9dd9-c1a58f88983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Flow 'volume_create_manager' (bf95b9ff-c6f6-409e-af84-4b84bb4c3126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8-a47573b9-a11c-4e68-a941-d39c9a3f17c3" acquired by "_create_volume_from_snapshot" :: waited 0.062s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Creating volume a47573b9-a11c-4e68-a941-d39c9a3f17c3 from snapshot 0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 {{(pid=86793) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-a47573b9-a11c-4e68-a941-d39c9a3f17c3" by "_copy_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:32 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f900370b-99a8-4ee5-9f82-a59dc255c1d1 tempest-VolumesTransfersTest-1802360279 None] Created volume successfully. Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-a47573b9-a11c-4e68-a941-d39c9a3f17c3" acquired by "_copy_volume_from_snapshot" :: waited 0.061s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] snapshot: 0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8, volume: a47573b9-a11c-4e68-a941-d39c9a3f17c3, {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-f7f7406d-4dcd-48f3-bfb3-2facf2a0d177 req-6d420e87-eac6-4bae-8679-8da28b9a973e tempest-TestShelveInstance-189878563 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-729f367e-9fe7-4c75-addb-aba35e056fdd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd13b8d2b-a689-471f-a397-8baccb324bb1', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c9467e-3fa1-4e56-8ee9-6b7701d1b854]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Flow 'volume_create_manager' (f06e7386-0d44-4ba6-89c3-e33f8959821e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:32 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 Sep 29 16:42:32 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c086cf-cdbe-4f8a-8bdb-4de12f82a18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:32 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-f7f7406d-4dcd-48f3-bfb3-2facf2a0d177 req-6d420e87-eac6-4bae-8679-8da28b9a973e tempest-TestShelveInstance-189878563 None] attachment_update completed successfully. Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c086cf-cdbe-4f8a-8bdb-4de12f82a18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2128384862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c588d78d-2421-42ac-8f6d-cb5492a99046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47c37f2fb73462ab5e2373744ce2f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:33Z,use_quota=True,user_id='aa208d4fee2748d4b0c63dfa699de82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d940eed-99c4-4312-a880-badf9d07f096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d940eed-99c4-4312-a880-badf9d07f096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7457c3-ed3a-42ed-b34b-92f365df56d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7457c3-ed3a-42ed-b34b-92f365df56d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c588d78d-2421-42ac-8f6d-cb5492a99046', 'volume_name': 'volume-c588d78d-2421-42ac-8f6d-cb5492a99046', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3fd987-289b-458f-8189-509e77615009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3fd987-289b-458f-8189-509e77615009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990c8bc6-c249-41f7-8fbe-16ccfe084257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:32 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Volume c588d78d-2421-42ac-8f6d-cb5492a99046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c588d78d-2421-42ac-8f6d-cb5492a99046', 'volume_size': 1} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Acquiring lock "cinder-6867dad2-d135-4a90-ae0f-1e7213173555-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Lock "cinder-6867dad2-d135-4a90-ae0f-1e7213173555-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Acquiring lock "cinder-quobyte-6867dad2-d135-4a90-ae0f-1e7213173555" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Lock "cinder-quobyte-6867dad2-d135-4a90-ae0f-1e7213173555" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:33 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f6a6f1-d4cf-400e-aa7a-c6745d43afc7]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6867dad2-d135-4a90-ae0f-1e7213173555 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:33 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8" returned: 0 in 0.528s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:42:33 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[86381729-29db-4e18-84b3-259a03b9664b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:33 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6867dad2-d135-4a90-ae0f-1e7213173555 Sep 29 16:42:33 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:33 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 Sep 29 16:42:33 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:33 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0" returned: 0 in 0.461s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] will copy from snapshot at /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 16:42:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Creating direct copy from snapshot {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 16:42:33 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:33 devstack cinder-volume[86793]: DEBUG cinder.utils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Path /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3 not found in is_blk_device check {{(pid=86793) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 16:42:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6867dad2-d135-4a90-ae0f-1e7213173555" returned: 0 in 0.534s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6867dad2-d135-4a90-ae0f-1e7213173555 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:33 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3 Sep 29 16:42:33 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:33 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6867dad2-d135-4a90-ae0f-1e7213173555 Sep 29 16:42:33 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:34 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6867dad2-d135-4a90-ae0f-1e7213173555" returned: 0 in 0.586s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Lock "cinder-quobyte-6867dad2-d135-4a90-ae0f-1e7213173555" released by "delete_volume" :: held 1.176s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Created reservations ['63242e41-76d9-418b-9b4d-f3f801a4bd19', 'c8697ea7-bcf3-48e2-91ea-f722566a1f0f', '239e461d-f629-4213-9677-d2b168879050', '896c3a31-f168-43ba-b8e8-0311cd0d93a4'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:34 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:42:34 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:34 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:42:34 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:35 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.693s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:42:35 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Deleted volume successfully. Sep 29 16:42:35 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cb9341dc-4666-4a3e-ac59-0699649f8292 tempest-VolumesTransfersTest-1137653364 None] Lock "cinder-6867dad2-d135-4a90-ae0f-1e7213173555-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:35 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.736s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:42:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:42:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:42:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:42:44 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3" returned: 0 in 10.756s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0, size 1024.00 MB, duration 10.76 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:42:44 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Converted 1024.00 MB image at 95.19 MB/s Sep 29 16:42:44 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3 is being set with open permissions: ugo+rw Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:44 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3 Sep 29 16:42:44 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=81,cinder:INSERT=33,cinder:UPDATE=87,cinder:DELETE=8 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:42:44 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3" returned: 0 in 0.476s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-a47573b9-a11c-4e68-a941-d39c9a3f17c3" released by "_copy_volume_from_snapshot" :: held 12.420s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8-a47573b9-a11c-4e68-a941-d39c9a3f17c3" released by "_create_volume_from_snapshot" :: held 12.553s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.617s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.049s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2128384862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c588d78d-2421-42ac-8f6d-cb5492a99046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47c37f2fb73462ab5e2373744ce2f91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:33Z,use_quota=True,user_id='aa208d4fee2748d4b0c63dfa699de82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Creating volume c588d78d-2421-42ac-8f6d-cb5492a99046 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:44 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c588d78d-2421-42ac-8f6d-cb5492a99046 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22a5eff-1f51-47c0-9987-b8f9647d4418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3', 'volume_size': 2, 'snapshot_id': '0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:44 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c588d78d-2421-42ac-8f6d-cb5492a99046 1073741824 Sep 29 16:42:44 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4b5423-1f6b-46fe-a583-4a0607208355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:44 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Volume volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3 (a47573b9-a11c-4e68-a941-d39c9a3f17c3): created successfully Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4b5423-1f6b-46fe-a583-4a0607208355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Flow 'volume_create_manager' (7bbd097b-186b-470c-89e9-cf59e0e8382c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:45 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5ad0af3a-123f-4b8c-a886-e9484a2077db tempest-VolumesSnapshotTestJSON-1962259830 None] Created volume successfully. Sep 29 16:42:45 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c588d78d-2421-42ac-8f6d-cb5492a99046 1073741824" returned: 0 in 0.669s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c588d78d-2421-42ac-8f6d-cb5492a99046 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:45 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c588d78d-2421-42ac-8f6d-cb5492a99046 Sep 29 16:42:45 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-a47573b9-a11c-4e68-a941-d39c9a3f17c3-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-a47573b9-a11c-4e68-a941-d39c9a3f17c3-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-a47573b9-a11c-4e68-a941-d39c9a3f17c3" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-a47573b9-a11c-4e68-a941-d39c9a3f17c3" acquired by "delete_volume" :: waited 0.033s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:46 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[35833dfe-5530-4349-bfed-7794c790f509]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:46 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c588d78d-2421-42ac-8f6d-cb5492a99046" returned: 0 in 0.509s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:42:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990c8bc6-c249-41f7-8fbe-16ccfe084257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c588d78d-2421-42ac-8f6d-cb5492a99046', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b0d1de-aebf-46a8-b815-7413d552b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:46 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Volume volume-c588d78d-2421-42ac-8f6d-cb5492a99046 (c588d78d-2421-42ac-8f6d-cb5492a99046): created successfully Sep 29 16:42:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b0d1de-aebf-46a8-b815-7413d552b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Flow 'volume_create_manager' (f06e7386-0d44-4ba6-89c3-e33f8959821e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:46 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3e5c908e-98b3-4706-b196-6197f6c95107 tempest-VolumesListAdminTestJSON-1533318943 None] Created volume successfully. Sep 29 16:42:46 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3 Sep 29 16:42:46 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:46 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3" returned: 0 in 0.606s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:46 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3 Sep 29 16:42:46 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:46 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a47573b9-a11c-4e68-a941-d39c9a3f17c3" returned: 0 in 0.300s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:46 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-a47573b9-a11c-4e68-a941-d39c9a3f17c3" released by "delete_volume" :: held 0.981s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:46 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=81,cinder:SELECT=99,cinder:INSERT=29,cinder:DELETE=8 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:42:47 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Created reservations ['549a498a-5301-4530-9563-8fa15327698a', '44ec652c-8bc0-497f-a87c-8d71e50cd0e2', '0853ac89-9338-40df-99da-4e17e4ad849f', 'ae1a4097-d087-44aa-8d0e-38986442fbed'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:42:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:47 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:42:47 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:47 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.315s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:47 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:42:47 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Deleted volume successfully. Sep 29 16:42:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1a010c69-cd0e-44fb-b1c8-59977faf96e1 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-a47573b9-a11c-4e68-a941-d39c9a3f17c3-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-a86bd45c-51cd-494e-bd43-b28a91b06eb0" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-a86bd45c-51cd-494e-bd43-b28a91b06eb0" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Deleting offline snapshot 0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 of volume a86bd45c-51cd-494e-bd43-b28a91b06eb0 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] snapshot_file for this snap is: volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fff9e4-04cf-42a0-842e-deb6b2a005d0]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Flow 'volume_create_manager' (b45b481c-6653-43b8-88f0-73617c7f1a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b8a691-1873-45e7-ad10-dcc079d6167f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b8a691-1873-45e7-ad10-dcc079d6167f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b11d728-41b0-453b-9ac2-05fb4afa3f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6d9ef8469948b28b456c1aa49429ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:48Z,use_quota=True,user_id='f5e8dffaebba43ab86551ba35a1268e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:48 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 Sep 29 16:42:48 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eed28c9-18b1-48e0-b96b-acd7410fd10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eed28c9-18b1-48e0-b96b-acd7410fd10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37a300c-06af-4b5d-8739-7ed59466e09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37a300c-06af-4b5d-8739-7ed59466e09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b11d728-41b0-453b-9ac2-05fb4afa3f00', 'volume_name': 'volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf38bc1c-3e11-4ca5-b8f4-4f1d18c793cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf38bc1c-3e11-4ca5-b8f4-4f1d18c793cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6492eaa-ee26-4357-867a-fec08ac4443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:48 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Volume 0b11d728-41b0-453b-9ac2-05fb4afa3f00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00', 'volume_size': 1} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b11d728-41b0-453b-9ac2-05fb4afa3f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f6d9ef8469948b28b456c1aa49429ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:48Z,use_quota=True,user_id='f5e8dffaebba43ab86551ba35a1268e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Creating volume 0b11d728-41b0-453b-9ac2-05fb4afa3f00 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:48 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:48 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00 1073741824 Sep 29 16:42:48 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:48 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8" returned: 0 in 0.475s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f19518-ba7e-42fb-8baf-328bd0c44259]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:49 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 Sep 29 16:42:49 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:49 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00 1073741824" returned: 0 in 0.526s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:49 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00 Sep 29 16:42:49 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:49 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00" returned: 0 in 0.327s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:42:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6492eaa-ee26-4357-867a-fec08ac4443d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d5fa5f-5c04-475c-a28a-f8dbe93117cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:49 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Volume volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00 (0b11d728-41b0-453b-9ac2-05fb4afa3f00): created successfully Sep 29 16:42:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d5fa5f-5c04-475c-a28a-f8dbe93117cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Flow 'volume_create_manager' (b45b481c-6653-43b8-88f0-73617c7f1a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:49 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5ec0200f-e59a-4373-b4df-2a90f0e0985b tempest-VolumesListAdminTestJSON-1230078106 None] Created volume successfully. Sep 29 16:42:49 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0" returned: 0 in 0.701s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:49 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 Sep 29 16:42:49 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:49 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8" returned: 0 in 0.360s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:50 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8 Sep 29 16:42:50 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Flow 'volume_create_manager' (5898ba16-9f68-487d-a437-098abe8c9887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cacd81ff-3112-433b-9b9e-2c6f552f9e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cacd81ff-3112-433b-9b9e-2c6f552f9e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1490970110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99062940-5709-4b59-8781-ebf1ef612189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f42bd3b94c14376a0bd96f2e78cd8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:50Z,use_quota=True,user_id='0e00fe44ecf844dd9feb2c7b3eee5eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:50 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9743cdf-de1c-4877-a1e1-b9d8094013f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9743cdf-de1c-4877-a1e1-b9d8094013f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eba5f74-b9f1-4ceb-8ef6-edfee7c3eec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eba5f74-b9f1-4ceb-8ef6-edfee7c3eec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99062940-5709-4b59-8781-ebf1ef612189', 'volume_name': 'volume-99062940-5709-4b59-8781-ebf1ef612189', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5175c9f4-ef30-450f-bb85-59dbd63f1136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5175c9f4-ef30-450f-bb85-59dbd63f1136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e1f35d-e64c-489c-bc61-e3d99089d7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:50 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Volume 99062940-5709-4b59-8781-ebf1ef612189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99062940-5709-4b59-8781-ebf1ef612189', 'volume_size': 1} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1490970110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99062940-5709-4b59-8781-ebf1ef612189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f42bd3b94c14376a0bd96f2e78cd8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:50Z,use_quota=True,user_id='0e00fe44ecf844dd9feb2c7b3eee5eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Creating volume 99062940-5709-4b59-8781-ebf1ef612189 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:50 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-99062940-5709-4b59-8781-ebf1ef612189 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0.0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8" returned: 0 in 0.310s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:50 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-99062940-5709-4b59-8781-ebf1ef612189 1073741824 Sep 29 16:42:50 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8" released by "_delete_snapshot" :: held 2.011s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-a86bd45c-51cd-494e-bd43-b28a91b06eb0" released by "delete_snapshot" :: held 2.066s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Created reservations ['91d64cac-3070-413d-a346-4bb4cfc5da02', 'b1560d80-a435-4b81-8a3c-eb7908038752', '02b4f1f4-e59a-438c-a9ab-a172fc3afa85', '127de8e7-08b5-44eb-9824-f7f6b7644184'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:42:50 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Delete snapshot completed successfully. Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee8501c6-a2bd-448b-83a7-a4b673453ca0 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-0c2bc6a3-35dd-4c20-8fb2-94a3b2707de8-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Acquiring lock "cinder-0b11d728-41b0-453b-9ac2-05fb4afa3f00-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Lock "cinder-0b11d728-41b0-453b-9ac2-05fb4afa3f00-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Acquiring lock "cinder-quobyte-0b11d728-41b0-453b-9ac2-05fb4afa3f00" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Lock "cinder-quobyte-0b11d728-41b0-453b-9ac2-05fb4afa3f00" acquired by "delete_volume" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[256f5d6e-1c67-4b36-a702-f3f7c5cab37c]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:50 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "cinder-c588d78d-2421-42ac-8f6d-cb5492a99046-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-99062940-5709-4b59-8781-ebf1ef612189 1073741824" returned: 0 in 0.618s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "cinder-c588d78d-2421-42ac-8f6d-cb5492a99046-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-99062940-5709-4b59-8781-ebf1ef612189 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "cinder-quobyte-c588d78d-2421-42ac-8f6d-cb5492a99046" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:51 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-99062940-5709-4b59-8781-ebf1ef612189 Sep 29 16:42:51 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "cinder-quobyte-c588d78d-2421-42ac-8f6d-cb5492a99046" acquired by "delete_volume" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:51 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00 Sep 29 16:42:51 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[56784c83-5f70-4c15-a3a7-5f4bf61ef540]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c588d78d-2421-42ac-8f6d-cb5492a99046 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:51 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c588d78d-2421-42ac-8f6d-cb5492a99046 Sep 29 16:42:51 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:51 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-99062940-5709-4b59-8781-ebf1ef612189" returned: 0 in 0.326s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e1f35d-e64c-489c-bc61-e3d99089d7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99062940-5709-4b59-8781-ebf1ef612189', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ca2713-9e65-4b64-9197-3799ffba9048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:51 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Volume volume-99062940-5709-4b59-8781-ebf1ef612189 (99062940-5709-4b59-8781-ebf1ef612189): created successfully Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1ca2713-9e65-4b64-9197-3799ffba9048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Flow 'volume_create_manager' (5898ba16-9f68-487d-a437-098abe8c9887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:51 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-8905908c-9f18-48bb-978a-abd75e1a77b9 tempest-VolumesTransfersV355Test-1174542684 None] Created volume successfully. Sep 29 16:42:51 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00" returned: 0 in 0.598s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:51 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00 Sep 29 16:42:51 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:51 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c588d78d-2421-42ac-8f6d-cb5492a99046" returned: 0 in 0.492s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c588d78d-2421-42ac-8f6d-cb5492a99046 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:51 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c588d78d-2421-42ac-8f6d-cb5492a99046 Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-a86bd45c-51cd-494e-bd43-b28a91b06eb0-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:51 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-a86bd45c-51cd-494e-bd43-b28a91b06eb0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-a86bd45c-51cd-494e-bd43-b28a91b06eb0" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-a86bd45c-51cd-494e-bd43-b28a91b06eb0" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99bac62-a843-4ed9-b195-4eebd17cd17f]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:51 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-0b11d728-41b0-453b-9ac2-05fb4afa3f00" returned: 0 in 0.308s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Lock "cinder-quobyte-0b11d728-41b0-453b-9ac2-05fb4afa3f00" released by "delete_volume" :: held 0.973s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Created reservations ['5b6511ef-dd6c-4ca1-9926-2e49d01bc7f0', '6eda9b34-d559-446b-8537-5a511adcfa8c', 'd7be1c57-cad0-4851-ad00-5919be23fb7c', 'ad594dd9-0254-44c8-8dee-70610dd28ddf'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:42:51 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 Sep 29 16:42:51 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:51 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c588d78d-2421-42ac-8f6d-cb5492a99046" returned: 0 in 0.414s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "cinder-quobyte-c588d78d-2421-42ac-8f6d-cb5492a99046" released by "delete_volume" :: held 0.963s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:51 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:42:51 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Created reservations ['c253c142-0731-44eb-920a-1ede6df3305b', 'e7a91a31-a168-43c9-af94-6939779c3cd9', '964d870d-ee2d-4795-a0f7-a504cc61b2e1', 'd49810fa-7095-4a1b-bb1c-66395680ae25'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:52 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:42:52 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:52 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.344s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:42:52 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Deleted volume successfully. Sep 29 16:42:52 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0" returned: 0 in 0.547s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3cd6cdf1-ca93-49ef-800b-f2dfe9bab172 tempest-VolumesListAdminTestJSON-1230078106 None] Lock "cinder-0b11d728-41b0-453b-9ac2-05fb4afa3f00-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:52 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0 Sep 29 16:42:52 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:52 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.417s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:42:52 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Deleted volume successfully. Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ab46741a-9111-4a99-ba88-6da2fe59fa72 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "cinder-c588d78d-2421-42ac-8f6d-cb5492a99046-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:52 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a86bd45c-51cd-494e-bd43-b28a91b06eb0" returned: 0 in 0.387s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-a86bd45c-51cd-494e-bd43-b28a91b06eb0" released by "delete_volume" :: held 1.012s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Created reservations ['513d8bbb-0cd9-4afd-9bcd-908a8ff9b754', 'aabc2ab3-aed2-4a14-b9fb-ca62a6823ad6', '46b289fb-bd1b-4cee-8ace-8b92d26cfe86', '6615a5f1-b398-41b2-8322-e819b647c16c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:52 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:42:52 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:53 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.278s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:42:53 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Deleted volume successfully. Sep 29 16:42:53 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c61c239c-7a5a-4cab-97eb-a2fbc6c46779 tempest-VolumesTransfersV355Test-699061206 None] Transfer volume completed successfully. Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-19ca7480-f2d8-4f89-85be-3d154b69ed91 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-a86bd45c-51cd-494e-bd43-b28a91b06eb0-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "cinder-47f25ad3-30b4-4eca-a543-f26ee3a7d085-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "cinder-47f25ad3-30b4-4eca-a543-f26ee3a7d085-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "cinder-quobyte-47f25ad3-30b4-4eca-a543-f26ee3a7d085" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "cinder-quobyte-47f25ad3-30b4-4eca-a543-f26ee3a7d085" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8e2fce-4df6-4b95-8cdb-c01881983f00]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:53 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085 Sep 29 16:42:53 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Acquiring lock "cinder-99062940-5709-4b59-8781-ebf1ef612189-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:53 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085" returned: 0 in 0.417s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Lock "cinder-99062940-5709-4b59-8781-ebf1ef612189-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:53 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085 Sep 29 16:42:53 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Acquiring lock "cinder-quobyte-99062940-5709-4b59-8781-ebf1ef612189" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Lock "cinder-quobyte-99062940-5709-4b59-8781-ebf1ef612189" acquired by "delete_volume" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce9bdf9-ba9b-4b43-b207-8faa1a8c8f0d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-99062940-5709-4b59-8781-ebf1ef612189 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:54 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-99062940-5709-4b59-8781-ebf1ef612189 Sep 29 16:42:54 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:54 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-47f25ad3-30b4-4eca-a543-f26ee3a7d085" returned: 0 in 0.336s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "cinder-quobyte-47f25ad3-30b4-4eca-a543-f26ee3a7d085" released by "delete_volume" :: held 0.814s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Created reservations ['977767b8-f9ed-43ea-9e77-6577eab54860', '111b3e89-a3d1-446e-afe2-2d9d40c75f08', 'd33643f0-506d-46f6-9862-0a0b6734e256', 'd8da03ea-1710-4121-b216-c97b3f10c7ae'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:54 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:42:54 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:54 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-99062940-5709-4b59-8781-ebf1ef612189" returned: 0 in 0.587s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-99062940-5709-4b59-8781-ebf1ef612189 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:54 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-99062940-5709-4b59-8781-ebf1ef612189 Sep 29 16:42:54 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "cinder-97a16753-bd87-472a-b81e-df174034c50a-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "cinder-97a16753-bd87-472a-b81e-df174034c50a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Flow 'volume_create_manager' (7d5d3137-79e4-4a69-a3c0-e59818d39356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e00b98-0d0c-4864-ab8a-e7bd184fcb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e00b98-0d0c-4864-ab8a-e7bd184fcb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1343561506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee989059-0e88-4215-8aa3-2a9454095c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb509d13dcdb49a89c0a119792917d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:55Z,use_quota=True,user_id='edf98ef9a282463ea728327922233e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24347fb0-1381-4cf9-a5c4-a906762c7554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24347fb0-1381-4cf9-a5c4-a906762c7554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357cbd41-43f4-4572-9968-1e56b1f4ca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357cbd41-43f4-4572-9968-1e56b1f4ca5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee989059-0e88-4215-8aa3-2a9454095c89', 'volume_name': 'volume-ee989059-0e88-4215-8aa3-2a9454095c89', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247ca529-8533-4152-9e21-bcc039d62cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247ca529-8533-4152-9e21-bcc039d62cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db44b4fd-cb6c-4df5-a3a7-8157d82dafe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:54 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:54 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Volume ee989059-0e88-4215-8aa3-2a9454095c89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee989059-0e88-4215-8aa3-2a9454095c89', 'volume_size': 1} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1343561506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee989059-0e88-4215-8aa3-2a9454095c89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb509d13dcdb49a89c0a119792917d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:55Z,use_quota=True,user_id='edf98ef9a282463ea728327922233e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Creating volume ee989059-0e88-4215-8aa3-2a9454095c89 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:54 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.458s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:42:54 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 1073741824 Sep 29 16:42:54 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:54 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Deleted volume successfully. Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6b995d5f-ed4d-4a01-9f06-4f87355ff226 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "cinder-47f25ad3-30b4-4eca-a543-f26ee3a7d085-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "cinder-quobyte-97a16753-bd87-472a-b81e-df174034c50a" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "cinder-quobyte-97a16753-bd87-472a-b81e-df174034c50a" acquired by "delete_volume" :: waited 0.034s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:55 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-99062940-5709-4b59-8781-ebf1ef612189" returned: 0 in 0.443s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9141ae-6f0a-40ca-9671-eaff5b8a852b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-97a16753-bd87-472a-b81e-df174034c50a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Lock "cinder-quobyte-99062940-5709-4b59-8781-ebf1ef612189" released by "delete_volume" :: held 1.101s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Created reservations ['9521e863-bcb8-4196-af46-263224dc8767', 'a8a21103-90e7-419c-af04-f040791121fa', '9bfc4631-7975-45b4-80d9-ab45766524ba', '8bad3305-3916-49b9-8a20-099cbf6fef37'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:42:55 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-97a16753-bd87-472a-b81e-df174034c50a Sep 29 16:42:55 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:55 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:42:55 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:55 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 1073741824" returned: 0 in 0.659s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:55 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-97a16753-bd87-472a-b81e-df174034c50a" returned: 0 in 0.514s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-97a16753-bd87-472a-b81e-df174034c50a {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:55 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.362s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:42:55 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-97a16753-bd87-472a-b81e-df174034c50a Sep 29 16:42:55 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:55 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Deleted volume successfully. Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3ecb3ef7-a3e2-4090-b8f4-b0257217907d tempest-VolumesTransfersV355Test-1572533150 None] Lock "cinder-99062940-5709-4b59-8781-ebf1ef612189-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:55 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 Sep 29 16:42:55 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:55 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89" returned: 0 in 0.302s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:55 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db44b4fd-cb6c-4df5-a3a7-8157d82dafe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee989059-0e88-4215-8aa3-2a9454095c89', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a2c20c-8b25-4cb7-90be-65ec008dacf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-97a16753-bd87-472a-b81e-df174034c50a" returned: 0 in 0.381s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "cinder-quobyte-97a16753-bd87-472a-b81e-df174034c50a" released by "delete_volume" :: held 0.966s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:55 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Volume volume-ee989059-0e88-4215-8aa3-2a9454095c89 (ee989059-0e88-4215-8aa3-2a9454095c89): created successfully Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a2c20c-8b25-4cb7-90be-65ec008dacf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Flow 'volume_create_manager' (7d5d3137-79e4-4a69-a3c0-e59818d39356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:56 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-791d93d4-5366-4d6d-92c7-1d0b476a0a25 tempest-VolumesSnapshotTestJSON-1962259830 None] Created volume successfully. Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Created reservations ['7b74fa75-7d20-4ecc-90c9-67b5c5bcef80', '69fae4f8-1340-48d4-90f3-8d7fdf0d0f7e', 'cc1690c8-39a5-45fe-ace1-d66f13d6573b', 'fc5b425c-70cd-4f91-90f0-27b64c55de53'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:56 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:42:56 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:56 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.272s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:42:56 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Deleted volume successfully. Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-8a4041cb-d35d-46dc-8299-8069f03a5ee3 tempest-VolumesListAdminTestJSON-1533318943 None] Lock "cinder-97a16753-bd87-472a-b81e-df174034c50a-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Flow 'volume_create_manager' (dcc167c7-587d-4922-b5ff-0f0f41b20efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbb43c8-6b69-4440-a01a-41522bfb5529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbb43c8-6b69-4440-a01a-41522bfb5529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-169751000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b0eb61-9c43-43e5-98ae-b5c389822f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f42bd3b94c14376a0bd96f2e78cd8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:57Z,use_quota=True,user_id='0e00fe44ecf844dd9feb2c7b3eee5eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9754fea-2a8d-438d-8822-4fcc0b8631f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9754fea-2a8d-438d-8822-4fcc0b8631f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e888ef74-72ba-4ba4-8a73-49d51617f540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e888ef74-72ba-4ba4-8a73-49d51617f540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65b0eb61-9c43-43e5-98ae-b5c389822f96', 'volume_name': 'volume-65b0eb61-9c43-43e5-98ae-b5c389822f96', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78186863-6ed5-4cd0-9036-c77e72ad1130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78186863-6ed5-4cd0-9036-c77e72ad1130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2200d825-9f59-415d-91c4-2419f3a5c78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:56 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Volume 65b0eb61-9c43-43e5-98ae-b5c389822f96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65b0eb61-9c43-43e5-98ae-b5c389822f96', 'volume_size': 1} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-169751000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b0eb61-9c43-43e5-98ae-b5c389822f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f42bd3b94c14376a0bd96f2e78cd8b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:42:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:42:57Z,use_quota=True,user_id='0e00fe44ecf844dd9feb2c7b3eee5eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Creating volume 65b0eb61-9c43-43e5-98ae-b5c389822f96 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:42:56 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-65b0eb61-9c43-43e5-98ae-b5c389822f96 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:56 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-65b0eb61-9c43-43e5-98ae-b5c389822f96 1073741824 Sep 29 16:42:56 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:42:57 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-65b0eb61-9c43-43e5-98ae-b5c389822f96 1073741824" returned: 0 in 0.450s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-65b0eb61-9c43-43e5-98ae-b5c389822f96 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:57 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-65b0eb61-9c43-43e5-98ae-b5c389822f96 Sep 29 16:42:57 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:57 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-65b0eb61-9c43-43e5-98ae-b5c389822f96" returned: 0 in 0.265s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:42:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.713s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:42:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2200d825-9f59-415d-91c4-2419f3a5c78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b0eb61-9c43-43e5-98ae-b5c389822f96', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71767609-088e-4cd5-b8dc-697cfb055c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:42:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] Creating offline snapshot 2da32784-c037-484d-a029-02cd684b847c of volume ee989059-0e88-4215-8aa3-2a9454095c89 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:42:57 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Volume volume-65b0eb61-9c43-43e5-98ae-b5c389822f96 (65b0eb61-9c43-43e5-98ae-b5c389822f96): created successfully Sep 29 16:42:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71767609-088e-4cd5-b8dc-697cfb055c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:42:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Flow 'volume_create_manager' (dcc167c7-587d-4922-b5ff-0f0f41b20efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:42:57 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95d4710-2f75-429f-9bb1-4705bfbcc18a]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4ca17efb-851b-4aad-9385-8f4f9e5d6f90 tempest-VolumesTransfersV355Test-1174542684 None] Created volume successfully. Sep 29 16:42:57 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 Sep 29 16:42:57 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:58 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89" returned: 0 in 0.361s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:58 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c 1G Sep 29 16:42:58 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:58 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c 1G" returned: 0 in 0.483s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee989059-0e88-4215-8aa3-2a9454095c89 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:58 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee989059-0e88-4215-8aa3-2a9454095c89 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c Sep 29 16:42:58 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:58 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee989059-0e88-4215-8aa3-2a9454095c89 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c" returned: 0 in 0.355s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:58 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c is being set with open permissions: ugo+rw Sep 29 16:42:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:58 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c Sep 29 16:42:58 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Acquiring lock "cinder-65b0eb61-9c43-43e5-98ae-b5c389822f96-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Lock "cinder-65b0eb61-9c43-43e5-98ae-b5c389822f96-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:59 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c" returned: 0 in 0.269s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Acquiring lock "cinder-quobyte-65b0eb61-9c43-43e5-98ae-b5c389822f96" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:42:59 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.info Sep 29 16:42:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Lock "cinder-quobyte-65b0eb61-9c43-43e5-98ae-b5c389822f96" acquired by "delete_volume" :: waited 0.021s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:42:59 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:59 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa9151d-0a98-4d71-8ace-1ed0765ef255]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:42:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-65b0eb61-9c43-43e5-98ae-b5c389822f96 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:59 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-65b0eb61-9c43-43e5-98ae-b5c389822f96 Sep 29 16:42:59 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:59 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.info" returned: 0 in 0.304s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:59 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.info is being set with open permissions: ugo+rw Sep 29 16:42:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:59 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.info Sep 29 16:42:59 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:59 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-65b0eb61-9c43-43e5-98ae-b5c389822f96" returned: 0 in 0.405s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-65b0eb61-9c43-43e5-98ae-b5c389822f96 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:42:59 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-65b0eb61-9c43-43e5-98ae-b5c389822f96 Sep 29 16:42:59 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:42:59 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Sep 29 16:42:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.info" returned: 0 in 0.281s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:42:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.199s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:42:59 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-935d965a-26be-4e5a-9a5e-57a4731ad025 tempest-VolumesSnapshotTestJSON-1962259830 None] Create snapshot completed successfully Sep 29 16:43:00 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-65b0eb61-9c43-43e5-98ae-b5c389822f96" returned: 0 in 0.336s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Lock "cinder-quobyte-65b0eb61-9c43-43e5-98ae-b5c389822f96" released by "delete_volume" :: held 0.812s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:00 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Created reservations ['de1b9976-178b-4a29-b939-d1db0ea0fbcd', '94442d00-b68f-4a87-9979-ea0412971ff0', 'ecf2e86d-888b-4a89-ad32-1dd9d0322738', 'e36fd452-3c5b-41ce-852b-d4f3af35f31a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:00 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:43:00 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:00 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.271s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:00 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:43:00 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Deleted volume successfully. Sep 29 16:43:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-65226efa-9233-4cb9-b505-95ba52fc5b5a tempest-VolumesTransfersV355Test-1572533150 None] Lock "cinder-65b0eb61-9c43-43e5-98ae-b5c389822f96-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Flow 'volume_create_manager' (aa00367f-57e5-4108-ae1f-4693fa57ab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8a47ad-85bc-4c6b-af4d-e7b5576458d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8a47ad-85bc-4c6b-af4d-e7b5576458d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-515154675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8896b76-002f-416a-aeaa-680aa52ea851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb509d13dcdb49a89c0a119792917d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2da32784-c037-484d-a029-02cd684b847c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:02Z,use_quota=True,user_id='edf98ef9a282463ea728327922233e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5654050f-3a54-4721-8ee2-179798077b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5654050f-3a54-4721-8ee2-179798077b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af74dfa-b0cc-454f-a901-f7e266fb7a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2af74dfa-b0cc-454f-a901-f7e266fb7a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8896b76-002f-416a-aeaa-680aa52ea851', 'volume_name': 'volume-b8896b76-002f-416a-aeaa-680aa52ea851', 'volume_size': 1, 'snapshot_id': '2da32784-c037-484d-a029-02cd684b847c'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cd8bf4-815f-4719-9e80-682e4a1ccdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cd8bf4-815f-4719-9e80-682e4a1ccdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3041a29c-4b31-43e9-9610-195d6141bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:01 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Volume b8896b76-002f-416a-aeaa-680aa52ea851: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8896b76-002f-416a-aeaa-680aa52ea851', 'volume_size': 1, 'snapshot_id': '2da32784-c037-484d-a029-02cd684b847c'} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-2da32784-c037-484d-a029-02cd684b847c-b8896b76-002f-416a-aeaa-680aa52ea851" by "_create_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-2da32784-c037-484d-a029-02cd684b847c-b8896b76-002f-416a-aeaa-680aa52ea851" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Creating volume b8896b76-002f-416a-aeaa-680aa52ea851 from snapshot 2da32784-c037-484d-a029-02cd684b847c {{(pid=86793) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-b8896b76-002f-416a-aeaa-680aa52ea851" by "_copy_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-b8896b76-002f-416a-aeaa-680aa52ea851" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] snapshot: 2da32784-c037-484d-a029-02cd684b847c, volume: b8896b76-002f-416a-aeaa-680aa52ea851, {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea975f1-b668-4fd5-98b9-5bb4249c75f2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:02 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c Sep 29 16:43:02 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:02 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c" returned: 0 in 0.460s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee989059-0e88-4215-8aa3-2a9454095c89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:43:02 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c5f9fe-e52f-4fa1-9945-18c03a660227]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:02 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 Sep 29 16:43:02 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:02 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89" returned: 0 in 0.565s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] will copy from snapshot at /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 16:43:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Creating direct copy from snapshot {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 16:43:02 devstack cinder-volume[86793]: DEBUG cinder.utils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Path /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851 not found in is_blk_device check {{(pid=86793) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 16:43:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:03 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851 Sep 29 16:43:03 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:11 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-cc433bc2-2f59-49b1-b599-fd228953e325 req-e2faa931-f8c2-4f9f-aa29-058bfd480d48 tempest-TestShelveInstance-189878563 None] Terminate volume connection completed successfully. Sep 29 16:43:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-cc433bc2-2f59-49b1-b599-fd228953e325 req-e2faa931-f8c2-4f9f-aa29-058bfd480d48 tempest-TestShelveInstance-189878563 None] Deleting attachment d13b8d2b-a689-471f-a397-8baccb324bb1. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:43:11 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=64,cinder:INSERT=18,cinder:UPDATE=73,cinder:DELETE=5 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:43:12 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:43:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Flow 'volume_create_manager' (40eb785c-9516-424e-bb73-21c270590928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db74f65d-5573-43d9-9906-9383e2887c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db74f65d-5573-43d9-9906-9383e2887c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1104044005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b6475c86774ed79ab94c8ba5f06dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:12Z,use_quota=True,user_id='fa4c45b634b2420e9ecbdf625ff61f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0100ee1-c268-45fb-9a49-e7038479474c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0100ee1-c268-45fb-9a49-e7038479474c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d53b57-ad12-42bf-bf31-fc01e0e61496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d53b57-ad12-42bf-bf31-fc01e0e61496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c', 'volume_name': 'volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c09243-53db-4290-b606-08ee8f284cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c09243-53db-4290-b606-08ee8f284cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cff5937-abed-49c3-b9e9-42ed5800858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:12 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Volume f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c', 'volume_size': 1} Sep 29 16:43:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:13 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851" returned: 0 in 10.082s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89, size 1024.00 MB, duration 10.09 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:43:13 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Converted 1024.00 MB image at 101.54 MB/s Sep 29 16:43:13 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851 is being set with open permissions: ugo+rw Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:13 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851 Sep 29 16:43:13 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Flow 'volume_create_manager' (d07a1506-2c92-42f2-bd42-75548ae174c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2c7861-05d9-4ccd-b276-1f877658dfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2c7861-05d9-4ccd-b276-1f877658dfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1658779833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2351ad30-db66-49ac-a9a1-44a81dd37fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4bc06116254b2fa66f653df071c65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:13Z,use_quota=True,user_id='35c647dd9997496789a6ca05c8cbb7a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0d57c1-5ed9-4149-a4a4-253109e60743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0d57c1-5ed9-4149-a4a4-253109e60743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4612c7e1-82fa-4cf9-b62a-2d80b5888dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.image.glance [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Creating Keystone auth plugin from conf {{(pid=86793) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 16:43:13 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851" returned: 0 in 0.319s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-b8896b76-002f-416a-aeaa-680aa52ea851" released by "_copy_volume_from_snapshot" :: held 11.560s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-2da32784-c037-484d-a029-02cd684b847c-b8896b76-002f-416a-aeaa-680aa52ea851" released by "_create_volume_from_snapshot" :: held 11.637s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.652s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.922s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1104044005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b6475c86774ed79ab94c8ba5f06dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:12Z,use_quota=True,user_id='fa4c45b634b2420e9ecbdf625ff61f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Creating volume f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:43:13 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:13 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c 1073741824 Sep 29 16:43:13 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3041a29c-4b31-43e9-9610-195d6141bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8896b76-002f-416a-aeaa-680aa52ea851', 'volume_size': 1, 'snapshot_id': '2da32784-c037-484d-a029-02cd684b847c'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ce0b2c-1a16-44dc-bee7-af9bb6428ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:13 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Volume volume-b8896b76-002f-416a-aeaa-680aa52ea851 (b8896b76-002f-416a-aeaa-680aa52ea851): created successfully Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ce0b2c-1a16-44dc-bee7-af9bb6428ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Flow 'volume_create_manager' (aa00367f-57e5-4108-ae1f-4693fa57ab9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4612c7e1-82fa-4cf9-b62a-2d80b5888dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2351ad30-db66-49ac-a9a1-44a81dd37fb2', 'volume_name': 'volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bb9c4b-2d20-4d24-93ab-f40ec45d9a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3bb9c4b-2d20-4d24-93ab-f40ec45d9a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938def94-9dc3-4909-bcbf-61751f31d6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:13 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Volume 2351ad30-db66-49ac-a9a1-44a81dd37fb2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Trying to clone 2351ad30-db66-49ac-a9a1-44a81dd37fb2 from image 041fad70-7851-4f49-af92-c1fc35c4c3b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]). {{(pid=86793) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 16:43:13 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b3430c63-c8d2-47ea-9f40-6d15dc9b6c71 tempest-VolumesSnapshotTestJSON-1962259830 None] Created volume successfully. Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_bahxoy5wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 16:43:13 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Image download 20.69 MB at 20.69 MB/s Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1815adde-7cc5-46d7-98c9-56c9b8dc11d2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_bahxoy5wdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:14 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c 1073741824" returned: 0 in 0.562s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:14 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c Sep 29 16:43:14 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:14 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_bahxoy5wdevstack@QuobyteHD Sep 29 16:43:14 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:14 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_bahxoy5wdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Temporary image 041fad70-7851-4f49-af92-c1fc35c4c3b2 is fetched for user 35c647dd9997496789a6ca05c8cbb7a9. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 16:43:14 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-b8896b76-002f-416a-aeaa-680aa52ea851-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c" returned: 0 in 0.374s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-b8896b76-002f-416a-aeaa-680aa52ea851-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cff5937-abed-49c3-b9e9-42ed5800858d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fdb0c35-10f3-4f1c-a0b4-f7582f878b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:14 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Volume volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c (f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c): created successfully Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fdb0c35-10f3-4f1c-a0b4-f7582f878b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Flow 'volume_create_manager' (40eb785c-9516-424e-bb73-21c270590928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[46df21b9-6abb-4775-81a2-33b3f91bc2f6]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_bahxoy5wdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:14 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-9186f9b8-a251-48fc-852a-b74f1275add5 tempest-AbsoluteLimitsTests-1255368300 None] Created volume successfully. Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-b8896b76-002f-416a-aeaa-680aa52ea851" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-b8896b76-002f-416a-aeaa-680aa52ea851" acquired by "delete_volume" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[16df8b87-979e-4fb5-a29d-7d5a4ec7217d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:14 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_bahxoy5wdevstack@QuobyteHD Sep 29 16:43:14 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:14 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851 Sep 29 16:43:14 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:14 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_bahxoy5wdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1658779833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2351ad30-db66-49ac-a9a1-44a81dd37fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4bc06116254b2fa66f653df071c65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:13Z,use_quota=True,user_id='35c647dd9997496789a6ca05c8cbb7a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Creating volume 2351ad30-db66-49ac-a9a1-44a81dd37fb2 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:43:14 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:43:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:14 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 1073741824 Sep 29 16:43:14 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:15 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851" returned: 0 in 0.391s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:15 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851 Sep 29 16:43:15 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:15 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b8896b76-002f-416a-aeaa-680aa52ea851" returned: 0 in 0.298s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-b8896b76-002f-416a-aeaa-680aa52ea851" released by "delete_volume" :: held 0.738s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Created reservations ['f557a43b-1899-4981-ac47-e0c05d7362e5', '8d612e7b-02f6-483b-ac77-e1f01de16820', '38b7f047-87be-4734-bd26-d65c86237dea', '4f656a9b-2eeb-46f7-910d-badab5d2b50f'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:15 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 1073741824" returned: 0 in 0.568s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:15 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:43:15 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:15 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 Sep 29 16:43:15 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-c9a854ab-721f-4116-bcef-46ce3b11e793 req-8fd67bb1-1188-48da-9f22-6da195404328 tempest-TestShelveInstance-189878563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:15 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.315s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:43:15 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Deleted volume successfully. Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Acquiring lock "cinder-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-87e51434-8464-433b-ae50-61b470ceb91d tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-b8896b76-002f-416a-aeaa-680aa52ea851-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:15 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2" returned: 0 in 0.338s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Lock "cinder-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-c9a854ab-721f-4116-bcef-46ce3b11e793 req-8fd67bb1-1188-48da-9f22-6da195404328 tempest-TestShelveInstance-189878563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.304s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-c9a854ab-721f-4116-bcef-46ce3b11e793 req-8fd67bb1-1188-48da-9f22-6da195404328 tempest-TestShelveInstance-189878563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Attempting download of 041fad70-7851-4f49-af92-c1fc35c4c3b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}])) to volume 2351ad30-db66-49ac-a9a1-44a81dd37fb2. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-2da32784-c037-484d-a029-02cd684b847c-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Acquiring lock "cinder-quobyte-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-2da32784-c037-484d-a029-02cd684b847c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-ee989059-0e88-4215-8aa3-2a9454095c89" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-c9a854ab-721f-4116-bcef-46ce3b11e793 req-8fd67bb1-1188-48da-9f22-6da195404328 tempest-TestShelveInstance-189878563 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-729f367e-9fe7-4c75-addb-aba35e056fdd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15213940-8d8a-4c05-9598-5b3bc62c3310', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Lock "cinder-quobyte-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c" acquired by "delete_volume" :: waited 0.046s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-ee989059-0e88-4215-8aa3-2a9454095c89" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-2da32784-c037-484d-a029-02cd684b847c" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b7fa8e-9d25-4b05-bd8a-47fea343625f]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9251dc99-acf6-4aea-91a1-a3470616231e]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_f7yf3gss {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-2da32784-c037-484d-a029-02cd684b847c" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Deleting offline snapshot 2da32784-c037-484d-a029-02cd684b847c of volume ee989059-0e88-4215-8aa3-2a9454095c89 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] snapshot_file for this snap is: volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d18c937-5e2e-4b46-bc88-10044f6f00d3]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:16 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c Sep 29 16:43:16 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:16 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-c9a854ab-721f-4116-bcef-46ce3b11e793 req-8fd67bb1-1188-48da-9f22-6da195404328 tempest-TestShelveInstance-189878563 None] attachment_update completed successfully. Sep 29 16:43:16 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_f7yf3gss Sep 29 16:43:16 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:16 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c Sep 29 16:43:16 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:16 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_f7yf3gss" returned: 0 in 0.414s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_f7yf3gss {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:16 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c" returned: 0 in 0.503s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:16 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c Sep 29 16:43:16 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:16 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_f7yf3gss Sep 29 16:43:16 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:16 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c" returned: 0 in 0.561s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee989059-0e88-4215-8aa3-2a9454095c89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1da0bc-2b06-42c7-be39-3af1b5c3b223]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:16 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:16 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 Sep 29 16:43:16 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c" returned: 0 in 0.316s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:16 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_f7yf3gss" returned: 1 in 0.404s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_041fad70-7851-4f49-af92-c1fc35c4c3b2_f7yf3gss' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Lock "cinder-quobyte-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c" released by "delete_volume" :: held 0.893s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a444022-d793-4e49-bc7d-dd7f347fd9ec]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_bahxoy5wdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:16 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Created reservations ['48aac586-ee51-470b-87ae-fbf3808f462c', 'a720c0be-33bf-49ce-8f0e-9ddbd3db3fac', '0f3c25c9-1155-45ec-a543-1f8ed1bd7002', 'cdb73d87-bc32-46ca-adc7-6bca42ac1dd0'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:17 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_bahxoy5wdevstack@QuobyteHD Sep 29 16:43:17 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:17 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:43:17 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:17 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.354s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:17 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:43:17 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Deleted volume successfully. Sep 29 16:43:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c4f8d18a-a31a-477b-8d99-2e39443d2c6f tempest-AbsoluteLimitsTests-1255368300 None] Lock "cinder-f7bc43fc-a0fc-42f9-9f25-8d1bbb562b9c-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:17 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_bahxoy5wdevstack@QuobyteHD" returned: 0 in 0.601s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:17 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] 041fad70-7851-4f49-af92-c1fc35c4c3b2 was qcow2, converting to qcow2 {{(pid=86793) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 16:43:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_bahxoy5wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:17 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_bahxoy5wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 Sep 29 16:43:17 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:17 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89" returned: 0 in 0.849s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:17 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c Sep 29 16:43:17 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:18 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c" returned: 0 in 0.414s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:18 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c Sep 29 16:43:18 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:18 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89.2da32784-c037-484d-a029-02cd684b847c" returned: 0 in 0.359s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-2da32784-c037-484d-a029-02cd684b847c" released by "_delete_snapshot" :: held 2.356s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-ee989059-0e88-4215-8aa3-2a9454095c89" released by "delete_snapshot" :: held 2.415s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:18 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Created reservations ['5b08f557-5210-4ca7-b52a-4da0afe1208d', 'a89494bf-e489-4b03-8b00-3094464e32e4', '3d7ea109-dae8-4d4f-a9a6-58f46a051e18', '0414d2a8-6675-47aa-9195-e5169cc1390a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:18 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Delete snapshot completed successfully. Sep 29 16:43:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d39d65c-8f6b-431b-aff1-e45eea81d362 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-2da32784-c037-484d-a029-02cd684b847c-delete_snapshot" released by "delete_snapshot" :: held 2.722s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:19 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-ee989059-0e88-4215-8aa3-2a9454095c89-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:19 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-ee989059-0e88-4215-8aa3-2a9454095c89-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:19 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-ee989059-0e88-4215-8aa3-2a9454095c89" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:19 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-ee989059-0e88-4215-8aa3-2a9454095c89" acquired by "delete_volume" :: waited 0.039s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:19 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[821ce6b3-2442-4dee-b001-097922d61cd7]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:19 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 Sep 29 16:43:19 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:20 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89" returned: 0 in 0.754s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:20 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_bahxoy5wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2" returned: 0 in 2.848s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:20 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_041fad70-7851-4f49-af92-c1fc35c4c3b2_bahxoy5wdevstack@QuobyteHD, size 112.00 MB, duration 2.85 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:43:20 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Converted 112.00 MB image at 39.26 MB/s Sep 29 16:43:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:20 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89 Sep 29 16:43:20 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:20 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 1G Sep 29 16:43:20 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:20 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee989059-0e88-4215-8aa3-2a9454095c89" returned: 0 in 0.517s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-ee989059-0e88-4215-8aa3-2a9454095c89" released by "delete_volume" :: held 1.406s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Created reservations ['fc81d651-7195-4fa5-b9a2-ab0bee2903bd', 'c2e7f09e-ff77-4f4c-9cf6-0fc72e182b99', '533f565b-cce6-47a0-bcd9-ab7cae4ab663', '772c8774-d619-4865-8ced-a133f9c84361'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:21 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 1G" returned: 0 in 0.816s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Downloaded image 041fad70-7851-4f49-af92-c1fc35c4c3b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}])) to volume 2351ad30-db66-49ac-a9a1-44a81dd37fb2 successfully. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Temporary image 041fad70-7851-4f49-af92-c1fc35c4c3b2 for user 35c647dd9997496789a6ca05c8cbb7a9 is deleted. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Marking volume 2351ad30-db66-49ac-a9a1-44a81dd37fb2 as bootable. {{(pid=86793) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Copying metadata from image 041fad70-7851-4f49-af92-c1fc35c4c3b2 to 2351ad30-db66-49ac-a9a1-44a81dd37fb2. {{(pid=86793) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Creating volume glance metadata for volume 2351ad30-db66-49ac-a9a1-44a81dd37fb2 backed by image 041fad70-7851-4f49-af92-c1fc35c4c3b2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86793) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:21 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:43:21 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938def94-9dc3-4909-bcbf-61751f31d6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2', 'volume_size': 1, 'image_id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/041fad70-7851-4f49-af92-c1fc35c4c3b2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c16756434b414a628695e5cf4ff53e00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '041fad70-7851-4f49-af92-c1fc35c4c3b2', 'created_at': datetime.datetime(2026, 9, 29, 14, 25, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 25, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/041fad70-7851-4f49-af92-c1fc35c4c3b2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5114370e-16ae-4bb8-9873-3e919b450505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:21 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Volume volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 (2351ad30-db66-49ac-a9a1-44a81dd37fb2): created successfully Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5114370e-16ae-4bb8-9873-3e919b450505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Flow 'volume_create_manager' (d07a1506-2c92-42f2-bd42-75548ae174c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:21 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-769cc90a-36da-4007-b38c-7bb1001f596f tempest-VolumesExtendTest-1920961477 None] Created volume successfully. Sep 29 16:43:21 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.489s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:43:21 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Deleted volume successfully. Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4744ee49-c1ac-4108-ab05-7a9eee509a11 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-ee989059-0e88-4215-8aa3-2a9454095c89-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-de4e2214-ce6b-4983-8fac-43437a3f2398-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-de4e2214-ce6b-4983-8fac-43437a3f2398-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:21 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "cinder-quobyte-de4e2214-ce6b-4983-8fac-43437a3f2398" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:22 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-de4e2214-ce6b-4983-8fac-43437a3f2398" acquired by "delete_volume" :: waited 0.027s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:22 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[14143f1e-7651-485e-b1d9-42126aba7e90]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c335de74-3141-4608-abec-cd4fe4cae071 tempest-VolumesExtendTest-1920961477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c335de74-3141-4608-abec-cd4fe4cae071 tempest-VolumesExtendTest-1920961477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:22 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec29adf-fdf2-4945-81b0-ea9c329eec87]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c335de74-3141-4608-abec-cd4fe4cae071 tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:22 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398 Sep 29 16:43:22 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:22 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 Sep 29 16:43:22 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:22 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398" returned: 0 in 0.574s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:22 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398 Sep 29 16:43:22 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:22 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c335de74-3141-4608-abec-cd4fe4cae071 tempest-VolumesExtendTest-1920961477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2" returned: 0 in 0.529s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c335de74-3141-4608-abec-cd4fe4cae071 tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 2G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c335de74-3141-4608-abec-cd4fe4cae071 tempest-VolumesExtendTest-1920961477 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 2G" returned: 0 in 0.187s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c335de74-3141-4608-abec-cd4fe4cae071 tempest-VolumesExtendTest-1920961477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.769s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:22 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c335de74-3141-4608-abec-cd4fe4cae071 tempest-VolumesExtendTest-1920961477 None] Extend volume completed successfully. Sep 29 16:43:22 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de4e2214-ce6b-4983-8fac-43437a3f2398" returned: 0 in 0.325s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-quobyte-de4e2214-ce6b-4983-8fac-43437a3f2398" released by "delete_volume" :: held 0.982s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:23 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Created reservations ['bf262413-4fc8-4319-bcde-db3563044361', '17a05447-4b52-4c52-bf44-313783c6d85a', 'b0a29b2d-dc7c-4aa8-8604-7873c4b7abbe', '5ca83281-7a0d-4522-b6b3-0a2109d4443f'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:23 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:43:23 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:23 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.356s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:23 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:43:23 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Deleted volume successfully. Sep 29 16:43:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2b0d1a-dc47-4d46-a0ef-7bd5cf1e2023 tempest-VolumesSnapshotTestJSON-1962259830 None] Lock "cinder-de4e2214-ce6b-4983-8fac-43437a3f2398-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Acquiring lock "cinder-2351ad30-db66-49ac-a9a1-44a81dd37fb2-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Lock "cinder-2351ad30-db66-49ac-a9a1-44a81dd37fb2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Acquiring lock "cinder-quobyte-2351ad30-db66-49ac-a9a1-44a81dd37fb2" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Lock "cinder-quobyte-2351ad30-db66-49ac-a9a1-44a81dd37fb2" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:24 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3777e415-9cca-48db-b153-3859b3bb84e7]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:24 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 Sep 29 16:43:24 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:25 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2" returned: 0 in 0.887s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:25 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2 Sep 29 16:43:25 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:25 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2351ad30-db66-49ac-a9a1-44a81dd37fb2" returned: 0 in 0.494s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Lock "cinder-quobyte-2351ad30-db66-49ac-a9a1-44a81dd37fb2" released by "delete_volume" :: held 1.461s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:25 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Created reservations ['c69193d0-d7c8-437e-a79c-6a391c440dc3', '4071c733-9f69-49ba-859c-90e70217ae6d', '4478f811-df91-43d3-8802-d434b556b335', '08633ca6-bb6b-4b16-b361-8d9abbdd3cb1'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:25 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:43:25 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:26 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.647s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:26 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:43:26 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Deleted volume successfully. Sep 29 16:43:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-89cd7454-0a59-4090-97b1-6f997c8ae3ff tempest-VolumesExtendTest-1920961477 None] Lock "cinder-2351ad30-db66-49ac-a9a1-44a81dd37fb2-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Flow 'volume_create_manager' (baa17e4e-f61a-462e-900e-588e68fac064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c407216f-27f0-4d76-83df-06ad635a9ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c407216f-27f0-4d76-83df-06ad635a9ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1960129042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145ccb09-cc30-4d2c-8c8b-9a808ac7e970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4bc06116254b2fa66f653df071c65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:27Z,use_quota=True,user_id='35c647dd9997496789a6ca05c8cbb7a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27705fa-c5f0-4ef2-9696-4edcf2ef6243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27705fa-c5f0-4ef2-9696-4edcf2ef6243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc92efe-7774-431d-8a33-5065719c250e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc92efe-7774-431d-8a33-5065719c250e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '145ccb09-cc30-4d2c-8c8b-9a808ac7e970', 'volume_name': 'volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2a48e2-635c-4639-8f16-bfe63ca3be46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2a48e2-635c-4639-8f16-bfe63ca3be46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242264ec-7b76-4910-91df-c37783adda0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:27 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Volume 145ccb09-cc30-4d2c-8c8b-9a808ac7e970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970', 'volume_size': 1} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1960129042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145ccb09-cc30-4d2c-8c8b-9a808ac7e970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc4bc06116254b2fa66f653df071c65f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:27Z,use_quota=True,user_id='35c647dd9997496789a6ca05c8cbb7a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Creating volume 145ccb09-cc30-4d2c-8c8b-9a808ac7e970 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:43:27 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:27 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 1073741824 Sep 29 16:43:27 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Flow 'volume_create_manager' (7b99c73d-e927-4b7d-aa59-4b5780ee8974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a6ac5a-828b-483a-a4ce-7a1fa63dcb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a6ac5a-828b-483a-a4ce-7a1fa63dcb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-627830039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9adc7a-c971-41a6-abfe-c979ae00f7a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b76e6f8c2d43e48aefe922b9dc52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:28Z,use_quota=True,user_id='1bb7bccd8aaa4ad9ab1595c5819dae37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503486ac-dbb0-4899-a42e-76b9963dae5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503486ac-dbb0-4899-a42e-76b9963dae5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a1b3cb-882b-4be0-abe5-6a1865369023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4a1b3cb-882b-4be0-abe5-6a1865369023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d9adc7a-c971-41a6-abfe-c979ae00f7a8', 'volume_name': 'volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e277a6a1-d3ff-4be0-baee-3f4e8562e4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e277a6a1-d3ff-4be0-baee-3f4e8562e4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22a4e14-779f-45f7-9c9b-640b532e98f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:27 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Volume 5d9adc7a-c971-41a6-abfe-c979ae00f7a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8', 'volume_size': 1} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:27 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 1073741824" returned: 0 in 0.655s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:28 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 Sep 29 16:43:28 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:28 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970" returned: 0 in 0.327s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-627830039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d9adc7a-c971-41a6-abfe-c979ae00f7a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b76e6f8c2d43e48aefe922b9dc52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:28Z,use_quota=True,user_id='1bb7bccd8aaa4ad9ab1595c5819dae37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Creating volume 5d9adc7a-c971-41a6-abfe-c979ae00f7a8 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:43:28 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242264ec-7b76-4910-91df-c37783adda0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c0a0b4-ba79-4b9c-8cb5-401544e77b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:28 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8 1073741824 Sep 29 16:43:28 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:28 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Volume volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 (145ccb09-cc30-4d2c-8c8b-9a808ac7e970): created successfully Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c0a0b4-ba79-4b9c-8cb5-401544e77b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Flow 'volume_create_manager' (baa17e4e-f61a-462e-900e-588e68fac064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:28 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f311c28c-aaa2-416b-9dca-9ed7ab42611c tempest-VolumesExtendTest-1920961477 None] Created volume successfully. Sep 29 16:43:28 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8 1073741824" returned: 0 in 0.509s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:28 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8 Sep 29 16:43:28 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:29 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8" returned: 0 in 0.283s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:29 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:43:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22a4e14-779f-45f7-9c9b-640b532e98f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a679465-4415-45b0-946a-c6a2bbb7f5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:29 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Volume volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8 (5d9adc7a-c971-41a6-abfe-c979ae00f7a8): created successfully Sep 29 16:43:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a679465-4415-45b0-946a-c6a2bbb7f5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Flow 'volume_create_manager' (7b99c73d-e927-4b7d-aa59-4b5780ee8974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:29 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b4f72f7f-d6e6-47b0-b462-e9889af933ae tempest-VolumesTransfersV357Test-1563040312 None] Created volume successfully. Sep 29 16:43:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:29 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] Creating offline snapshot 462a0fb5-7d95-40c4-a5cf-620d047de42c of volume 145ccb09-cc30-4d2c-8c8b-9a808ac7e970 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:43:29 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[42962e5e-6a1d-4b69-a512-0f0280d24af2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:29 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 Sep 29 16:43:29 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:30 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970" returned: 0 in 0.491s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:30 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c 1G Sep 29 16:43:30 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:30 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1fb21a53-9c8c-4a7e-ad52-7982db4ffd5d tempest-VolumesTransfersV357Test-1765024021 None] Transfer volume completed successfully. Sep 29 16:43:31 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c 1G" returned: 0 in 0.767s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:31 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c Sep 29 16:43:31 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:31 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c" returned: 0 in 0.373s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:31 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c is being set with open permissions: ugo+rw Sep 29 16:43:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:31 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c Sep 29 16:43:31 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:31 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c" returned: 0 in 0.302s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:31 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.info Sep 29 16:43:31 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Acquiring lock "cinder-5d9adc7a-c971-41a6-abfe-c979ae00f7a8-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Lock "cinder-5d9adc7a-c971-41a6-abfe-c979ae00f7a8-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Acquiring lock "cinder-quobyte-5d9adc7a-c971-41a6-abfe-c979ae00f7a8" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Lock "cinder-quobyte-5d9adc7a-c971-41a6-abfe-c979ae00f7a8" acquired by "delete_volume" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:32 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ab8ab0-13e4-4884-90b5-169e3c3b45d3]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:32 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.info" returned: 0 in 0.398s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:32 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.info is being set with open permissions: ugo+rw Sep 29 16:43:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:32 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.info Sep 29 16:43:32 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:32 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8 Sep 29 16:43:32 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:32 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.info" returned: 0 in 0.331s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.837s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:32 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8" returned: 0 in 0.482s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:32 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-536432de-87ba-4e65-833e-238436387bba tempest-VolumesExtendTest-1920961477 None] Create snapshot completed successfully Sep 29 16:43:32 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8 Sep 29 16:43:32 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:32 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5d9adc7a-c971-41a6-abfe-c979ae00f7a8" returned: 0 in 0.286s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Lock "cinder-quobyte-5d9adc7a-c971-41a6-abfe-c979ae00f7a8" released by "delete_volume" :: held 0.819s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:32 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Created reservations ['47bec1f0-c8d6-469f-9a28-006326f42c60', '682007b9-4b69-4985-a3f3-a33f501f201d', '1528287a-fdb0-474e-b853-0f46af3d655d', '894d5a06-9007-46cb-b6d3-2012ae327bb0'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-06a0ddaf-b5bd-4a59-8a15-cce50b678f63 tempest-VolumesExtendTest-1920961477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-06a0ddaf-b5bd-4a59-8a15-cce50b678f63 tempest-VolumesExtendTest-1920961477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2395eb-891f-45a9-9ec0-5b3cd93b2065]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-06a0ddaf-b5bd-4a59-8a15-cce50b678f63 tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:33 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:43:33 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:33 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 Sep 29 16:43:33 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:33 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.500s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:43:33 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Deleted volume successfully. Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1cfc57c8-99ed-4017-a6a5-787489cfc7cf tempest-VolumesTransfersV357Test-412415206 None] Lock "cinder-5d9adc7a-c971-41a6-abfe-c979ae00f7a8-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:33 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-06a0ddaf-b5bd-4a59-8a15-cce50b678f63 tempest-VolumesExtendTest-1920961477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970" returned: 0 in 0.739s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-06a0ddaf-b5bd-4a59-8a15-cce50b678f63 tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c 2G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Flow 'volume_create_manager' (94a4cf5e-3388-4b4d-b1ab-f1677aac2e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c070557d-50f1-42bb-9525-356249c728e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c070557d-50f1-42bb-9525-356249c728e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1805670036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7557de47-6c5e-4f86-8b21-578253104877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b76e6f8c2d43e48aefe922b9dc52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:34Z,use_quota=True,user_id='1bb7bccd8aaa4ad9ab1595c5819dae37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (428f8706-96d0-4060-bc61-4911f56a38c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (428f8706-96d0-4060-bc61-4911f56a38c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6cdf6c-76b3-420e-9355-5f56f31a3249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6cdf6c-76b3-420e-9355-5f56f31a3249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7557de47-6c5e-4f86-8b21-578253104877', 'volume_name': 'volume-7557de47-6c5e-4f86-8b21-578253104877', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1acdaee6-9119-433a-a98f-6527a238fcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1acdaee6-9119-433a-a98f-6527a238fcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac82b929-add0-40fb-b64a-04316b45985c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:34 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Volume 7557de47-6c5e-4f86-8b21-578253104877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7557de47-6c5e-4f86-8b21-578253104877', 'volume_size': 1} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-06a0ddaf-b5bd-4a59-8a15-cce50b678f63 tempest-VolumesExtendTest-1920961477 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c 2G" returned: 0 in 0.219s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-06a0ddaf-b5bd-4a59-8a15-cce50b678f63 tempest-VolumesExtendTest-1920961477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1805670036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7557de47-6c5e-4f86-8b21-578253104877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b76e6f8c2d43e48aefe922b9dc52bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:34Z,use_quota=True,user_id='1bb7bccd8aaa4ad9ab1595c5819dae37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Creating volume 7557de47-6c5e-4f86-8b21-578253104877 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:43:34 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7557de47-6c5e-4f86-8b21-578253104877 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:34 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7557de47-6c5e-4f86-8b21-578253104877 1073741824 Sep 29 16:43:34 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:34 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-06a0ddaf-b5bd-4a59-8a15-cce50b678f63 tempest-VolumesExtendTest-1920961477 None] Extend volume completed successfully. Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Acquiring lock "cinder-462a0fb5-7d95-40c4-a5cf-620d047de42c-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Lock "cinder-462a0fb5-7d95-40c4-a5cf-620d047de42c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Acquiring lock "cinder-quobyte-145ccb09-cc30-4d2c-8c8b-9a808ac7e970" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Lock "cinder-quobyte-145ccb09-cc30-4d2c-8c8b-9a808ac7e970" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Acquiring lock "cinder-quobyte-462a0fb5-7d95-40c4-a5cf-620d047de42c" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Lock "cinder-quobyte-462a0fb5-7d95-40c4-a5cf-620d047de42c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Deleting offline snapshot 462a0fb5-7d95-40c4-a5cf-620d047de42c of volume 145ccb09-cc30-4d2c-8c8b-9a808ac7e970 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] snapshot_file for this snap is: volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec3d662-dabb-47f5-a230-79a80294b8b2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:34 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c Sep 29 16:43:34 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:34 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7557de47-6c5e-4f86-8b21-578253104877 1073741824" returned: 0 in 0.620s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7557de47-6c5e-4f86-8b21-578253104877 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:34 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7557de47-6c5e-4f86-8b21-578253104877 Sep 29 16:43:34 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:34 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:43:34 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:35 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c" returned: 0 in 0.650s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:35 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.349s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3946e91-2107-4fbc-92fa-47a10ce7b3ee]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:35 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7557de47-6c5e-4f86-8b21-578253104877" returned: 0 in 0.500s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac82b929-add0-40fb-b64a-04316b45985c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7557de47-6c5e-4f86-8b21-578253104877', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f6b0ca-4cc8-4fee-b890-4366151ffb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:35 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Volume volume-7557de47-6c5e-4f86-8b21-578253104877 (7557de47-6c5e-4f86-8b21-578253104877): created successfully Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f6b0ca-4cc8-4fee-b890-4366151ffb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Flow 'volume_create_manager' (94a4cf5e-3388-4b4d-b1ab-f1677aac2e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:43:35 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 Sep 29 16:43:35 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Flow 'volume_create_manager' (3ba2c90d-1f11-444d-b61f-62f9ce6407ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1b533c-4b76-445d-8eb7-15e33ef8a92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:35 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c7a888b9-a137-4df1-b931-17336d9cef56 tempest-VolumesTransfersV357Test-1563040312 None] Created volume successfully. Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1b533c-4b76-445d-8eb7-15e33ef8a92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1404563110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4826e196-9edd-4fc6-ad0b-0a91ef29df14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e760c17686324341bbca678c62595c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:35Z,use_quota=True,user_id='8efdf0ce739140878b9ee900efbf5c6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27acbed1-3405-466e-a31b-97b37d73aab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27acbed1-3405-466e-a31b-97b37d73aab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc79b265-663e-4945-a2c9-03c44a594e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc79b265-663e-4945-a2c9-03c44a594e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4826e196-9edd-4fc6-ad0b-0a91ef29df14', 'volume_name': 'volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598ef50a-2088-41b4-aa4f-a7b0d091b219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598ef50a-2088-41b4-aa4f-a7b0d091b219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30cac21b-a878-426c-ab33-30f2e5b98ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:35 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Volume 4826e196-9edd-4fc6-ad0b-0a91ef29df14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14', 'volume_size': 1} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1404563110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4826e196-9edd-4fc6-ad0b-0a91ef29df14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e760c17686324341bbca678c62595c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:35Z,use_quota=True,user_id='8efdf0ce739140878b9ee900efbf5c6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Creating volume 4826e196-9edd-4fc6-ad0b-0a91ef29df14 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:43:35 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:35 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 1073741824 Sep 29 16:43:35 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:35 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970" returned: 0 in 0.443s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:35 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c Sep 29 16:43:35 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:35 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 1073741824" returned: 0 in 0.484s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:35 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 Sep 29 16:43:35 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:36 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c" returned: 0 in 0.527s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:36 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c Sep 29 16:43:36 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:36 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14" returned: 0 in 0.358s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30cac21b-a878-426c-ab33-30f2e5b98ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75818044-317e-446a-87b8-473601bce9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:36 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Volume volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 (4826e196-9edd-4fc6-ad0b-0a91ef29df14): created successfully Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75818044-317e-446a-87b8-473601bce9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Flow 'volume_create_manager' (3ba2c90d-1f11-444d-b61f-62f9ce6407ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:36 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3588fcd2-4075-4374-825a-9473f9e882ef tempest-VolumesSnapshotListTestJSON-599219846 None] Created volume successfully. Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Acquiring lock "cinder-7557de47-6c5e-4f86-8b21-578253104877-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Lock "cinder-7557de47-6c5e-4f86-8b21-578253104877-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Acquiring lock "cinder-quobyte-7557de47-6c5e-4f86-8b21-578253104877" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:36 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Lock "cinder-quobyte-7557de47-6c5e-4f86-8b21-578253104877" acquired by "delete_volume" :: waited 0.021s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970.462a0fb5-7d95-40c4-a5cf-620d047de42c" returned: 0 in 0.359s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e243c103-eb4a-42d5-a3ad-95a3c03a1e4d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7557de47-6c5e-4f86-8b21-578253104877 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Lock "cinder-quobyte-462a0fb5-7d95-40c4-a5cf-620d047de42c" released by "_delete_snapshot" :: held 2.130s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Lock "cinder-quobyte-145ccb09-cc30-4d2c-8c8b-9a808ac7e970" released by "delete_snapshot" :: held 2.163s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Created reservations ['9753d5ef-2c3d-440a-ac1d-77df5dae396f', '8a76cb45-f329-4050-a8db-ec4c87291aea', '63aab89f-5ccc-4373-861d-9b52ddccd133', '21d72057-06b0-4b01-8d26-13e1cba0950b'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:36 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7557de47-6c5e-4f86-8b21-578253104877 Sep 29 16:43:36 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:36 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Delete snapshot completed successfully. Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f2c12bb8-26fb-4909-a63a-f939fc686447 tempest-VolumesExtendTest-1920961477 None] Lock "cinder-462a0fb5-7d95-40c4-a5cf-620d047de42c-delete_snapshot" released by "delete_snapshot" :: held 2.313s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:36 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7557de47-6c5e-4f86-8b21-578253104877" returned: 0 in 0.397s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7557de47-6c5e-4f86-8b21-578253104877 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:36 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7557de47-6c5e-4f86-8b21-578253104877 Sep 29 16:43:36 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:37 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7557de47-6c5e-4f86-8b21-578253104877" returned: 0 in 0.261s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Lock "cinder-quobyte-7557de47-6c5e-4f86-8b21-578253104877" released by "delete_volume" :: held 0.742s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Created reservations ['36172e33-1091-4640-8d2b-9dae661f4253', 'd1760d7b-3dac-4fb1-ab1c-c605dc53b46f', '624e51f9-92ee-4f81-9e84-87c5c2f6372a', '0f2fd140-6ab9-451b-a47a-55cebd884d27'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:37 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:43:37 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] Creating offline snapshot b98792bc-6844-4c85-a904-fbe285a402f2 of volume 4826e196-9edd-4fc6-ad0b-0a91ef29df14 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d10c8fa-ae96-44f9-aa62-0c6607de585b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Acquiring lock "cinder-145ccb09-cc30-4d2c-8c8b-9a808ac7e970-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Lock "cinder-145ccb09-cc30-4d2c-8c8b-9a808ac7e970-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:37 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 Sep 29 16:43:37 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:37 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.502s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Acquiring lock "cinder-quobyte-145ccb09-cc30-4d2c-8c8b-9a808ac7e970" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:37 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Deleted volume successfully. Sep 29 16:43:37 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Lock "cinder-quobyte-145ccb09-cc30-4d2c-8c8b-9a808ac7e970" acquired by "delete_volume" :: waited 0.045s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:38 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ef74913e-740f-4056-87aa-bc1a3cd4d430 tempest-VolumesTransfersV357Test-412415206 None] Lock "cinder-7557de47-6c5e-4f86-8b21-578253104877-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:38 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3072cad8-fd54-40a2-8dcc-68666d74b858]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:38 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14" returned: 0 in 0.500s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:38 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 Sep 29 16:43:38 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:38 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 1G Sep 29 16:43:38 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:38 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970" returned: 0 in 0.487s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:38 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970 Sep 29 16:43:38 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:38 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 1G" returned: 0 in 0.617s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:38 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-145ccb09-cc30-4d2c-8c8b-9a808ac7e970" returned: 0 in 0.315s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:38 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 Sep 29 16:43:38 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:38 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Lock "cinder-quobyte-145ccb09-cc30-4d2c-8c8b-9a808ac7e970" released by "delete_volume" :: held 0.905s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:38 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Created reservations ['65eb2099-445a-4f84-891b-efb7d1d75ee8', '162dda6a-2102-483f-83d1-8f29accde074', '378881e5-2d6c-49d9-bd0c-277c71421eac', '1d330314-e55d-4fca-898d-61e012ae468b'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:39 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:43:39 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:39 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2" returned: 0 in 0.451s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:39 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 is being set with open permissions: ugo+rw Sep 29 16:43:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:39 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 Sep 29 16:43:39 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:39 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.370s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:39 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:43:39 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Deleted volume successfully. Sep 29 16:43:39 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-80620065-e5c2-43f8-8a76-23f7893d234b tempest-VolumesExtendTest-1920961477 None] Lock "cinder-145ccb09-cc30-4d2c-8c8b-9a808ac7e970-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:39 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2" returned: 0 in 0.368s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:39 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.info Sep 29 16:43:39 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:40 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.info" returned: 0 in 0.387s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:40 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.info is being set with open permissions: ugo+rw Sep 29 16:43:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:40 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.info Sep 29 16:43:40 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:40 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.info" returned: 0 in 0.337s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.838s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:40 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-03ab8aeb-75ec-4477-83fd-052666250d1c tempest-VolumesSnapshotListTestJSON-599219846 None] Create snapshot completed successfully Sep 29 16:43:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:40 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] Creating offline snapshot 4f4f320d-90cb-48bb-abde-722ceaeeff22 of volume 4826e196-9edd-4fc6-ad0b-0a91ef29df14 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:43:41 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[45474410-841d-42e7-8733-6cef7c767c29]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:41 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 Sep 29 16:43:41 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:41 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2" returned: 0 in 0.415s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:43:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:41 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 1G Sep 29 16:43:41 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:42 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 1G" returned: 0 in 0.629s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:42 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 Sep 29 16:43:42 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:42 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22" returned: 0 in 0.329s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:42 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 is being set with open permissions: ugo+rw Sep 29 16:43:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:42 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 Sep 29 16:43:42 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:42 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22" returned: 0 in 0.275s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.785s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:42 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b25fbeaf-7dee-4558-9ee8-b779a7911285 tempest-VolumesSnapshotListTestJSON-599219846 None] Create snapshot completed successfully Sep 29 16:43:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] Creating offline snapshot 68f422c2-e1c8-4341-8f1a-bd3dc39454a3 of volume 4826e196-9edd-4fc6-ad0b-0a91ef29df14 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:43:43 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[210abd2a-e6dc-4b9c-b5ba-918dd2c43bbe]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:43 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 Sep 29 16:43:43 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:43 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22" returned: 0 in 0.432s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:43:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:43 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 1G Sep 29 16:43:43 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:44 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 1G" returned: 0 in 0.648s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:44 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 Sep 29 16:43:44 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:44 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3" returned: 0 in 0.389s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:44 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 is being set with open permissions: ugo+rw Sep 29 16:43:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:44 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 Sep 29 16:43:44 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:45 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3" returned: 0 in 0.364s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=211,cinder:SELECT=146,cinder:DELETE=22,cinder:INSERT=57 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:45 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c1f163de-75f3-4625-8fc0-3ee9286db6f5 tempest-VolumesSnapshotListTestJSON-599219846 None] Create snapshot completed successfully Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Flow 'volume_create_manager' (7c1c94c6-dc9e-471b-91a1-297b1d1e227e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d621f20-eb7e-48cf-a4c4-c5a41ca4928d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d621f20-eb7e-48cf-a4c4-c5a41ca4928d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-306008683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065ba6d7-1a57-4605-9eb3-b5e77f7ae597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe56e85b3624010a58346d559bfe247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:46Z,use_quota=True,user_id='bf6978b424c74de48cc28a86bc99ee32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e911e9-f3ce-42fb-aad5-32d58c11e906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e911e9-f3ce-42fb-aad5-32d58c11e906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc88992-a679-4b82-83d6-a27cc315f258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc88992-a679-4b82-83d6-a27cc315f258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '065ba6d7-1a57-4605-9eb3-b5e77f7ae597', 'volume_name': 'volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035325b8-d4f3-4ba1-945b-01e201a2aae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (035325b8-d4f3-4ba1-945b-01e201a2aae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44975b1-8a62-4b63-be60-c056d99247ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:45 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Volume 065ba6d7-1a57-4605-9eb3-b5e77f7ae597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597', 'volume_size': 1} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-306008683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=065ba6d7-1a57-4605-9eb3-b5e77f7ae597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe56e85b3624010a58346d559bfe247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:46Z,use_quota=True,user_id='bf6978b424c74de48cc28a86bc99ee32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Creating volume 065ba6d7-1a57-4605-9eb3-b5e77f7ae597 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:43:45 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:43:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:45 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 1073741824 Sep 29 16:43:45 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:46 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 1073741824" returned: 0 in 0.544s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:46 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 Sep 29 16:43:46 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "cinder-68f422c2-e1c8-4341-8f1a-bd3dc39454a3-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:46 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-68f422c2-e1c8-4341-8f1a-bd3dc39454a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "cinder-quobyte-4826e196-9edd-4fc6-ad0b-0a91ef29df14" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597" returned: 0 in 0.366s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-quobyte-4826e196-9edd-4fc6-ad0b-0a91ef29df14" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "cinder-quobyte-68f422c2-e1c8-4341-8f1a-bd3dc39454a3" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44975b1-8a62-4b63-be60-c056d99247ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32de0aa5-bf62-4209-a0b9-3c75f9bc709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-quobyte-68f422c2-e1c8-4341-8f1a-bd3dc39454a3" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Deleting offline snapshot 68f422c2-e1c8-4341-8f1a-bd3dc39454a3 of volume 4826e196-9edd-4fc6-ad0b-0a91ef29df14 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] snapshot_file for this snap is: volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:43:46 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Volume volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 (065ba6d7-1a57-4605-9eb3-b5e77f7ae597): created successfully Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32de0aa5-bf62-4209-a0b9-3c75f9bc709d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Flow 'volume_create_manager' (7c1c94c6-dc9e-471b-91a1-297b1d1e227e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb087bd-7518-4563-a57d-858ec10406ca]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:46 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-056894eb-0311-4fd2-ac68-b67273f03d70 tempest-VolumesCloneTest-1360041045 None] Created volume successfully. Sep 29 16:43:46 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 Sep 29 16:43:46 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:47 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3" returned: 0 in 0.405s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:43:47 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1631c7-8551-4149-9b16-91bdbf289ff3]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:47 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 Sep 29 16:43:47 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:47 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22" returned: 0 in 0.460s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:43:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:47 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 Sep 29 16:43:47 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Flow 'volume_create_manager' (b0ccca86-77ee-46c3-a569-2da024f3279d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c21653a-028b-4ec2-89f3-f732b9abf98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c21653a-028b-4ec2-89f3-f732b9abf98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e465c9b-9567-41d0-8047-5e034024b500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2e96b0f3344de3b710061be30405ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:48Z,use_quota=True,user_id='f0946181d4d340cfa0fcab68c04a9a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05d9b3a4-5a7c-4232-843d-cc43330c8ba0),volume_type_id=05d9b3a4-5a7c-4232-843d-cc43330c8ba0)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fb955f-34a0-45b2-9b77-97ebdccc42be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fb955f-34a0-45b2-9b77-97ebdccc42be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786dcfce-662a-4fb5-9d9a-1f7fa5b1c8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.image.glance [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Creating Keystone auth plugin from conf {{(pid=86793) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 16:43:48 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3" returned: 0 in 0.669s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:48 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3 Sep 29 16:43:48 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Flow 'volume_create_manager' (eca7349d-6686-4326-b330-063e14f67ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e2e779-3e3e-4bf4-8f0a-5cccc1b833b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e2e779-3e3e-4bf4-8f0a-5cccc1b833b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-896354483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce346cde-5a9e-4951-9e7c-cbb9b837f5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfe56e85b3624010a58346d559bfe247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=065ba6d7-1a57-4605-9eb3-b5e77f7ae597,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:48Z,use_quota=True,user_id='bf6978b424c74de48cc28a86bc99ee32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1f3582-2c9c-432b-a48a-32184bdfeffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1f3582-2c9c-432b-a48a-32184bdfeffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073c3733-a9ff-47e5-8a3d-36e0d6e78f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073c3733-a9ff-47e5-8a3d-36e0d6e78f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ce346cde-5a9e-4951-9e7c-cbb9b837f5fd', 'volume_name': 'volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd', 'volume_size': 2, 'source_volid': '065ba6d7-1a57-4605-9eb3-b5e77f7ae597', 'source_volstatus': 'available'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4faab4ac-2af5-4416-b6f3-b7f926b5a393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4faab4ac-2af5-4416-b6f3-b7f926b5a393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea5b18c-e927-45c5-a06b-778cedf09a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:48 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Volume ce346cde-5a9e-4951-9e7c-cbb9b837f5fd: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd', 'volume_size': 2, 'source_volid': '065ba6d7-1a57-4605-9eb3-b5e77f7ae597', 'source_volstatus': 'available'} Sep 29 16:43:48 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.68f422c2-e1c8-4341-8f1a-bd3dc39454a3" returned: 0 in 0.307s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786dcfce-662a-4fb5-9d9a-1f7fa5b1c8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e465c9b-9567-41d0-8047-5e034024b500', 'volume_name': 'volume-3e465c9b-9567-41d0-8047-5e034024b500', 'volume_size': 1, 'image_id': '838352d8-40d6-4cec-9707-8e484a9a3f98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/838352d8-40d6-4cec-9707-8e484a9a3f98', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a2403e28358b3e3313d17b810c4c2e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d2e96b0f3344de3b710061be30405ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f1665c457b863a3a21b0bba2b076781829df5e6ae5b11f0083f049439dd10151c14acf297403a11d71394259b964bbdaa7ed48d6259ddd15237e4944382bc651', 'id': '838352d8-40d6-4cec-9707-8e484a9a3f98', 'created_at': datetime.datetime(2026, 9, 29, 14, 43, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 43, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/838352d8-40d6-4cec-9707-8e484a9a3f98/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1539ef1-f1ea-4a61-a287-cc9a08f2d05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1539ef1-f1ea-4a61-a287-cc9a08f2d05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3a5003-4459-4cad-bc63-423f988a7a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:43:48 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Volume 3e465c9b-9567-41d0-8047-5e034024b500: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e465c9b-9567-41d0-8047-5e034024b500', 'volume_size': 1, 'image_id': '838352d8-40d6-4cec-9707-8e484a9a3f98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/838352d8-40d6-4cec-9707-8e484a9a3f98', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a2403e28358b3e3313d17b810c4c2e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d2e96b0f3344de3b710061be30405ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f1665c457b863a3a21b0bba2b076781829df5e6ae5b11f0083f049439dd10151c14acf297403a11d71394259b964bbdaa7ed48d6259ddd15237e4944382bc651', 'id': '838352d8-40d6-4cec-9707-8e484a9a3f98', 'created_at': datetime.datetime(2026, 9, 29, 14, 43, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 43, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/838352d8-40d6-4cec-9707-8e484a9a3f98/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Trying to clone 3e465c9b-9567-41d0-8047-5e034024b500 from image 838352d8-40d6-4cec-9707-8e484a9a3f98 at location (None, [{'url': 'file:///opt/stack/data/glance/images/838352d8-40d6-4cec-9707-8e484a9a3f98', 'metadata': {}}]). {{(pid=86793) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:48 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Cloning volume 065ba6d7-1a57-4605-9eb3-b5e77f7ae597 to volume ce346cde-5a9e-4951-9e7c-cbb9b837f5fd Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-quobyte-68f422c2-e1c8-4341-8f1a-bd3dc39454a3" released by "_delete_snapshot" :: held 2.013s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-quobyte-4826e196-9edd-4fc6-ad0b-0a91ef29df14" released by "delete_snapshot" :: held 2.055s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Creating offline snapshot 996f2d3e-fbe8-4a1b-8f25-744fcb85577d of volume 065ba6d7-1a57-4605-9eb3-b5e77f7ae597 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d0ab69-5fc0-4080-b381-d90098d434bd]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 16:43:48 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Image download 0.00 MB at 0.00 MB/s Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Created reservations ['a4dea987-5392-4100-8915-16f4dc55b33e', 'd467cb42-9964-4353-9ca1-7b9bdfd886fc', '37c1629b-4bdf-4b90-b852-42a7a06e3d34', 'cf182cab-6040-4599-b9b2-4ae2a9d950b3'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[61be2a92-0a5b-4fd1-9392-83eec457f404]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:48 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Delete snapshot completed successfully. Sep 29 16:43:48 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 Sep 29 16:43:48 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f3496e-78d1-42f5-a029-6f0a34ee31e9 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-68f422c2-e1c8-4341-8f1a-bd3dc39454a3-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "cinder-4f4f320d-90cb-48bb-abde-722ceaeeff22-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-4f4f320d-90cb-48bb-abde-722ceaeeff22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "cinder-quobyte-4826e196-9edd-4fc6-ad0b-0a91ef29df14" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:49 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD Sep 29 16:43:49 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-quobyte-4826e196-9edd-4fc6-ad0b-0a91ef29df14" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "cinder-quobyte-4f4f320d-90cb-48bb-abde-722ceaeeff22" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-quobyte-4f4f320d-90cb-48bb-abde-722ceaeeff22" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Deleting offline snapshot 4f4f320d-90cb-48bb-abde-722ceaeeff22 of volume 4826e196-9edd-4fc6-ad0b-0a91ef29df14 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] snapshot_file for this snap is: volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e529e3b-b1fc-42b5-8b66-224a3c211557]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:49 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 Sep 29 16:43:49 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:49 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:49 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597" returned: 0 in 0.471s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:49 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d 1G Sep 29 16:43:49 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:49 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD Sep 29 16:43:49 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:49 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22" returned: 0 in 0.399s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4025d42-8347-48fd-a04d-7ef5efac446e]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:49 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:49 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 Sep 29 16:43:49 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Temporary image 838352d8-40d6-4cec-9707-8e484a9a3f98 is fetched for user f0946181d4d340cfa0fcab68c04a9a73. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 16:43:49 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d 1G" returned: 0 in 0.413s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:49 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d Sep 29 16:43:49 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8694429-d975-426d-99dc-4462449701ba]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:49 devstack sudo[101790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD Sep 29 16:43:49 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:49 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2" returned: 0 in 0.404s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:49 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 Sep 29 16:43:49 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:49 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d" returned: 0 in 0.313s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:49 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d is being set with open permissions: ugo+rw Sep 29 16:43:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:50 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d Sep 29 16:43:50 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:50 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:50 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD Sep 29 16:43:50 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:50 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d" returned: 0 in 0.275s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:50 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.info Sep 29 16:43:50 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:50 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22" returned: 0 in 0.453s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:50 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:50 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22 Sep 29 16:43:50 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:50 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.info" returned: 0 in 0.280s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:50 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.info is being set with open permissions: ugo+rw Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:50 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.info Sep 29 16:43:50 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:50 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.4f4f320d-90cb-48bb-abde-722ceaeeff22" returned: 0 in 0.258s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-quobyte-4f4f320d-90cb-48bb-abde-722ceaeeff22" released by "_delete_snapshot" :: held 1.627s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-quobyte-4826e196-9edd-4fc6-ad0b-0a91ef29df14" released by "delete_snapshot" :: held 1.654s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Created reservations ['a6ed59d0-bb89-461d-b577-2c4095532c91', '0335389a-c36c-4495-a4a1-91839ad6a566', 'fb76553f-e81c-45ae-96ce-4ebb68cef818', 'c06fa03d-81f3-4775-80b0-66a8d7786614'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:50 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Delete snapshot completed successfully. Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d74cb40d-96a5-4e8b-b05e-5b783ecfe3e1 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-4f4f320d-90cb-48bb-abde-722ceaeeff22-delete_snapshot" released by "delete_snapshot" :: held 1.787s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:50 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.info" returned: 0 in 0.244s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Acquiring lock "cinder-quobyte-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd" by "_copy_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Lock "cinder-quobyte-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] snapshot: 996f2d3e-fbe8-4a1b-8f25-744fcb85577d, volume: ce346cde-5a9e-4951-9e7c-cbb9b837f5fd, {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1104f2a6-df4d-4a59-b5ea-f1dfe1212bfb]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:50 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d Sep 29 16:43:50 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "cinder-b98792bc-6844-4c85-a904-fbe285a402f2-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-b98792bc-6844-4c85-a904-fbe285a402f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "cinder-quobyte-4826e196-9edd-4fc6-ad0b-0a91ef29df14" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-quobyte-4826e196-9edd-4fc6-ad0b-0a91ef29df14" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "cinder-quobyte-b98792bc-6844-4c85-a904-fbe285a402f2" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-quobyte-b98792bc-6844-4c85-a904-fbe285a402f2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Deleting offline snapshot b98792bc-6844-4c85-a904-fbe285a402f2 of volume 4826e196-9edd-4fc6-ad0b-0a91ef29df14 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] snapshot_file for this snap is: volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[551617d4-57ce-484f-ae19-f1588ba8563c]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:51 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d" returned: 0 in 0.378s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7792c4a5-56f0-47ba-b60e-9ae24200e580]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:51 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 Sep 29 16:43:51 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:51 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 Sep 29 16:43:51 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:51 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2" returned: 0 in 0.378s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[00df0fd3-9013-4aa3-860e-057f06359311]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:51 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597" returned: 0 in 0.374s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Creating direct copy from snapshot {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG cinder.utils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Path /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd not found in is_blk_device check {{(pid=86793) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 16:43:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:51 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd Sep 29 16:43:51 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:51 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 Sep 29 16:43:51 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:52 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14" returned: 0 in 0.372s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:52 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 Sep 29 16:43:52 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:52 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2" returned: 0 in 0.768s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:52 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2 Sep 29 16:43:52 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:53 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14.b98792bc-6844-4c85-a904-fbe285a402f2" returned: 0 in 0.502s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-quobyte-b98792bc-6844-4c85-a904-fbe285a402f2" released by "_delete_snapshot" :: held 2.197s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-quobyte-4826e196-9edd-4fc6-ad0b-0a91ef29df14" released by "delete_snapshot" :: held 2.227s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:53 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Created reservations ['651a8d41-0278-4bff-be68-af9c226d3cb1', 'f6674f4b-74cf-4700-adc1-4a43e7137d7d', '91390915-8b7b-4c06-b8dd-8cf1d125c66b', 'd9d898ea-7e19-44d2-a57c-580d1f11d594'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:53 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Delete snapshot completed successfully. Sep 29 16:43:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ba662da-25fa-4d00-8521-4f92da45e010 tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-b98792bc-6844-4c85-a904-fbe285a402f2-delete_snapshot" released by "delete_snapshot" :: held 2.419s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "cinder-4826e196-9edd-4fc6-ad0b-0a91ef29df14-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-4826e196-9edd-4fc6-ad0b-0a91ef29df14-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "cinder-quobyte-4826e196-9edd-4fc6-ad0b-0a91ef29df14" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-quobyte-4826e196-9edd-4fc6-ad0b-0a91ef29df14" acquired by "delete_volume" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:54 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[222b0206-b66b-419d-81fc-34d1144f0a64]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:54 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 Sep 29 16:43:54 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:55 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14" returned: 0 in 0.490s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:55 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14 Sep 29 16:43:55 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:55 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4826e196-9edd-4fc6-ad0b-0a91ef29df14" returned: 0 in 0.366s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-quobyte-4826e196-9edd-4fc6-ad0b-0a91ef29df14" released by "delete_volume" :: held 1.011s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:55 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Created reservations ['eeef5308-1b80-4cc0-9252-8193cb3e391a', '836cd2c0-79b3-4ba2-8fd1-18516577c1da', '207d836f-b2b2-40f5-bbaf-6def0e89e897', '4eb4f56e-7882-462a-9db5-bca1196dff50'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:43:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:43:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:43:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:43:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:43:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:43:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:55 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:43:55 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:56 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.290s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:56 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:43:56 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Deleted volume successfully. Sep 29 16:43:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-05d20d95-30c4-433d-b2bd-519d544bf96f tempest-VolumesSnapshotListTestJSON-599219846 None] Lock "cinder-4826e196-9edd-4fc6-ad0b-0a91ef29df14-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:58 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd" returned: 0 in 6.530s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:43:58 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Converted 1024.00 MB image at 156.77 MB/s Sep 29 16:43:58 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd is being set with open permissions: ugo+rw Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:58 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd Sep 29 16:43:58 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:58 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd" returned: 0 in 0.252s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Lock "cinder-quobyte-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd" released by "_copy_volume_from_snapshot" :: held 7.617s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Acquiring lock "cinder-quobyte-996f2d3e-fbe8-4a1b-8f25-744fcb85577d" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Lock "cinder-quobyte-996f2d3e-fbe8-4a1b-8f25-744fcb85577d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Deleting offline snapshot 996f2d3e-fbe8-4a1b-8f25-744fcb85577d of volume 065ba6d7-1a57-4605-9eb3-b5e77f7ae597 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] snapshot_file for this snap is: volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df78081-0d65-401c-9e46-86690ca05b6b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:58 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d Sep 29 16:43:58 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:58 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d" returned: 0 in 0.392s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e702bb5-716e-42ba-909b-5571c6863a80]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:43:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:59 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 Sep 29 16:43:59 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:59 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597" returned: 0 in 0.550s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:59 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d Sep 29 16:43:59 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:43:59 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Sep 29 16:43:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d" returned: 0 in 0.342s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:43:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:43:59 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d Sep 29 16:43:59 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:00 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597.996f2d3e-fbe8-4a1b-8f25-744fcb85577d" returned: 0 in 0.259s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Lock "cinder-quobyte-996f2d3e-fbe8-4a1b-8f25-744fcb85577d" released by "_delete_snapshot" :: held 1.653s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.470s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.773s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e465c9b-9567-41d0-8047-5e034024b500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d2e96b0f3344de3b710061be30405ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:43:48Z,use_quota=True,user_id='f0946181d4d340cfa0fcab68c04a9a73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05d9b3a4-5a7c-4232-843d-cc43330c8ba0),volume_type_id=05d9b3a4-5a7c-4232-843d-cc43330c8ba0)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Creating volume 3e465c9b-9567-41d0-8047-5e034024b500 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:00 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea5b18c-e927-45c5-a06b-778cedf09a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd', 'volume_size': 2, 'source_volid': '065ba6d7-1a57-4605-9eb3-b5e77f7ae597', 'source_volstatus': 'available'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8550c86d-1361-4a4a-9061-4eba46eb27ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:00 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 1073741824 Sep 29 16:44:00 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:00 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Volume volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd (ce346cde-5a9e-4951-9e7c-cbb9b837f5fd): created successfully Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8550c86d-1361-4a4a-9061-4eba46eb27ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Flow 'volume_create_manager' (eca7349d-6686-4326-b330-063e14f67ebc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:00 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-30cb0060-faf3-4f7e-95a9-ff4512c7f406 tempest-VolumesCloneTest-1360041045 None] Created volume successfully. Sep 29 16:44:00 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 1073741824" returned: 0 in 0.557s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:00 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 Sep 29 16:44:00 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:01 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500" returned: 0 in 0.329s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:01 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Attempting download of 838352d8-40d6-4cec-9707-8e484a9a3f98 ((None, [{'url': 'file:///opt/stack/data/glance/images/838352d8-40d6-4cec-9707-8e484a9a3f98', 'metadata': {}}])) to volume 3e465c9b-9567-41d0-8047-5e034024b500. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 16:44:01 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc44f8d-2678-4873-b471-5c29668dbece]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_838352d8-40d6-4cec-9707-8e484a9a3f98_gohoagft {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:01 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_838352d8-40d6-4cec-9707-8e484a9a3f98_gohoagft Sep 29 16:44:01 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:01 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_838352d8-40d6-4cec-9707-8e484a9a3f98_gohoagft" returned: 0 in 0.572s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_838352d8-40d6-4cec-9707-8e484a9a3f98_gohoagft {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Acquiring lock "cinder-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Lock "cinder-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Acquiring lock "cinder-quobyte-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Lock "cinder-quobyte-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd" acquired by "delete_volume" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:02 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_838352d8-40d6-4cec-9707-8e484a9a3f98_gohoagft Sep 29 16:44:02 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:02 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a828070f-e17c-4382-8072-986333a4c4f2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:02 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd Sep 29 16:44:02 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:02 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_838352d8-40d6-4cec-9707-8e484a9a3f98_gohoagft" returned: 1 in 0.518s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_838352d8-40d6-4cec-9707-8e484a9a3f98_gohoagft' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:44:02 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc9d6d6-6e23-4b66-82df-07c513f59f97]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:02 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD Sep 29 16:44:02 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:02 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd" returned: 0 in 0.600s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:02 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd Sep 29 16:44:02 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:02 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD" returned: 0 in 0.586s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:03 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD Sep 29 16:44:03 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:03 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd" returned: 0 in 0.453s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Lock "cinder-quobyte-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd" released by "delete_volume" :: held 1.148s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Created reservations ['67a4b1cc-52d7-477c-b52a-6497e41e5581', 'dd4b2914-1283-44d2-b079-5fe544a77e71', '81751eb8-0883-4cb9-8cca-7e4b18d1de20', 'ea3e5553-d330-4b93-831f-4785c5ac6328'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:03 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD" returned: 1 in 0.436s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] 838352d8-40d6-4cec-9707-8e484a9a3f98 was raw, converting to qcow2 {{(pid=86793) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:03 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:03 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:03 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:03 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:03 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.386s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:03 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Deleted volume successfully. Sep 29 16:44:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6baa47b-66b5-46f6-9adf-61ecb3c0ba1b tempest-VolumesCloneTest-1360041045 None] Lock "cinder-ce346cde-5a9e-4951-9e7c-cbb9b837f5fd-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:04 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500" returned: 0 in 0.665s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_838352d8-40d6-4cec-9707-8e484a9a3f98_wn0ndqgodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:44:04 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:04 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 1G Sep 29 16:44:04 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:04 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-a8cfafe3-fb0e-4de8-aa05-d3ede7458d04 tempest-TestShelveInstance-189878563 None] Terminate volume connection completed successfully. Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-a8cfafe3-fb0e-4de8-aa05-d3ede7458d04 tempest-TestShelveInstance-189878563 None] Deleting attachment 15213940-8d8a-4c05-9598-5b3bc62c3310. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Acquiring lock "cinder-065ba6d7-1a57-4605-9eb3-b5e77f7ae597-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:04 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 1G" returned: 0 in 0.424s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Downloaded image 838352d8-40d6-4cec-9707-8e484a9a3f98 ((None, [{'url': 'file:///opt/stack/data/glance/images/838352d8-40d6-4cec-9707-8e484a9a3f98', 'metadata': {}}])) to volume 3e465c9b-9567-41d0-8047-5e034024b500 successfully. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Temporary image 838352d8-40d6-4cec-9707-8e484a9a3f98 for user f0946181d4d340cfa0fcab68c04a9a73 is deleted. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Marking volume 3e465c9b-9567-41d0-8047-5e034024b500 as bootable. {{(pid=86793) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Lock "cinder-065ba6d7-1a57-4605-9eb3-b5e77f7ae597-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Copying metadata from image 838352d8-40d6-4cec-9707-8e484a9a3f98 to 3e465c9b-9567-41d0-8047-5e034024b500. {{(pid=86793) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Creating volume glance metadata for volume 3e465c9b-9567-41d0-8047-5e034024b500 backed by image 838352d8-40d6-4cec-9707-8e484a9a3f98 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '838352d8-40d6-4cec-9707-8e484a9a3f98', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0a2403e28358b3e3313d17b810c4c2e5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86793) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Acquiring lock "cinder-quobyte-065ba6d7-1a57-4605-9eb3-b5e77f7ae597" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Lock "cinder-quobyte-065ba6d7-1a57-4605-9eb3-b5e77f7ae597" acquired by "delete_volume" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Acquiring lock "cinder-729f367e-9fe7-4c75-addb-aba35e056fdd-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaec99e-2aca-441a-948b-18f8d74f93f1]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Lock "cinder-729f367e-9fe7-4c75-addb-aba35e056fdd-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3a5003-4459-4cad-bc63-423f988a7a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e465c9b-9567-41d0-8047-5e034024b500', 'volume_size': 1, 'image_id': '838352d8-40d6-4cec-9707-8e484a9a3f98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/838352d8-40d6-4cec-9707-8e484a9a3f98', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0a2403e28358b3e3313d17b810c4c2e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6d2e96b0f3344de3b710061be30405ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f1665c457b863a3a21b0bba2b076781829df5e6ae5b11f0083f049439dd10151c14acf297403a11d71394259b964bbdaa7ed48d6259ddd15237e4944382bc651', 'id': '838352d8-40d6-4cec-9707-8e484a9a3f98', 'created_at': datetime.datetime(2026, 9, 29, 14, 43, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 43, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/838352d8-40d6-4cec-9707-8e484a9a3f98/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd424265-4818-4fc7-9cf8-b91bbd499ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:04 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Volume volume-3e465c9b-9567-41d0-8047-5e034024b500 (3e465c9b-9567-41d0-8047-5e034024b500): created successfully Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd424265-4818-4fc7-9cf8-b91bbd499ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Flow 'volume_create_manager' (b0ccca86-77ee-46c3-a569-2da024f3279d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Acquiring lock "cinder-quobyte-729f367e-9fe7-4c75-addb-aba35e056fdd" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Lock "cinder-quobyte-729f367e-9fe7-4c75-addb-aba35e056fdd" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:04 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-9ab60b31-0458-42e2-b35d-31d3bc31abe3 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Created volume successfully. Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9ae4d3-fee1-4d75-858b-e163361eaf01]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:04 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 Sep 29 16:44:04 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:05 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd Sep 29 16:44:05 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:05 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597" returned: 0 in 0.582s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:05 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597 Sep 29 16:44:05 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:05 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd" returned: 0 in 0.472s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:05 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd Sep 29 16:44:05 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Acquiring lock "cinder-3e465c9b-9567-41d0-8047-5e034024b500-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Lock "cinder-3e465c9b-9567-41d0-8047-5e034024b500-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Acquiring lock "cinder-quobyte-3e465c9b-9567-41d0-8047-5e034024b500" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:05 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Lock "cinder-quobyte-3e465c9b-9567-41d0-8047-5e034024b500" acquired by "delete_volume" :: waited 0.032s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:05 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-065ba6d7-1a57-4605-9eb3-b5e77f7ae597" returned: 0 in 0.554s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-729f367e-9fe7-4c75-addb-aba35e056fdd" returned: 0 in 0.448s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7f7915-aec8-4185-a135-fb31eceb4b24]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Lock "cinder-quobyte-065ba6d7-1a57-4605-9eb3-b5e77f7ae597" released by "delete_volume" :: held 1.270s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Lock "cinder-quobyte-729f367e-9fe7-4c75-addb-aba35e056fdd" released by "delete_volume" :: held 1.039s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:05 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Created reservations ['32a191ce-901c-4c97-bdb9-21e68fc485d2', 'd40fca0f-74e3-4c26-9efc-891eb237e0b0', '86eed278-273e-49f3-b637-00351a28e39f', '4ad5bcc8-11ff-4c30-b3b3-fad7a291fee9'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG cinder.quota [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Created reservations ['4d6da8cb-367e-46d5-9e03-9ccaf8400b8d', '4f13a9fa-0fb1-46b4-b442-63d07809d354', '30227958-74a2-45bb-90e4-7f8bfc5e375e', 'ee8aa11a-3209-4c33-a643-f1629b6922f2'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:06 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 Sep 29 16:44:06 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:06 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:06 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:06 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:06 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:06 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.415s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:06 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Deleted volume successfully. Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500" returned: 0 in 0.688s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-abc8b8b6-0e00-4015-818d-e54ebefdac7a tempest-VolumesCloneTest-1360041045 None] Lock "cinder-065ba6d7-1a57-4605-9eb3-b5e77f7ae597-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:06 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500 Sep 29 16:44:06 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:06 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.452s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG cinder.manager [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Deleted volume successfully. Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [req-8347be36-1f47-47f8-b73d-a4f28a709876 req-dda6cfcc-89b5-44da-a6be-48bcc83c70b0 tempest-TestShelveInstance-189878563 None] Lock "cinder-729f367e-9fe7-4c75-addb-aba35e056fdd-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:06 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e465c9b-9567-41d0-8047-5e034024b500" returned: 0 in 0.357s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Lock "cinder-quobyte-3e465c9b-9567-41d0-8047-5e034024b500" released by "delete_volume" :: held 1.143s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:06 devstack cinder-volume[86793]: WARNING cinder.quota [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:44:06 devstack cinder-volume[86793]: WARNING cinder.quota [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:44:07 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Created reservations ['c20f76b6-5bf7-42ae-b5f5-35efce5650d8', 'd655d1af-14c4-4a82-8717-5b3a80449828', 'd5f3ba3b-0bd8-46e4-8c34-7859a202c792', '9b66e4a4-1c8a-431a-8858-1d9405aa8f5e'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:07 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:07 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:07 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.306s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:07 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:07 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Deleted volume successfully. Sep 29 16:44:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c911f408-2b75-4c25-b4ab-b8aa6760e9a9 tempest-VolumeAndVolumeTypeFromImageTest-1907732504 None] Lock "cinder-3e465c9b-9567-41d0-8047-5e034024b500-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:14 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=173,cinder:SELECT=151,cinder:INSERT=48,cinder:DELETE=8 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Flow 'volume_create_manager' (a22fc80f-b0fe-4fb2-8ccd-5c16b475ef3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3732e00f-14c7-4baf-8ce9-e828b1fc780f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3732e00f-14c7-4baf-8ce9-e828b1fc780f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-573564838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e8648a-7138-4fbd-a06f-0f8c318d5cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a69283ede0422db8d06a16d2c8c7a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:18Z,use_quota=True,user_id='25f0231d38be4c8ca353b5073139414f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02438f5f-78c6-419a-83df-c79e87323b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02438f5f-78c6-419a-83df-c79e87323b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62be6e0-12ac-48db-b62d-82edde028e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62be6e0-12ac-48db-b62d-82edde028e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3e8648a-7138-4fbd-a06f-0f8c318d5cd8', 'volume_name': 'volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a49928-712b-498c-9f91-bebe893336a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20a49928-712b-498c-9f91-bebe893336a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a64be08-127c-48ce-bfb6-7159358fef8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:17 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Volume e3e8648a-7138-4fbd-a06f-0f8c318d5cd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8', 'volume_size': 1} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-573564838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e8648a-7138-4fbd-a06f-0f8c318d5cd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a69283ede0422db8d06a16d2c8c7a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:18Z,use_quota=True,user_id='25f0231d38be4c8ca353b5073139414f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Creating volume e3e8648a-7138-4fbd-a06f-0f8c318d5cd8 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:17 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:18 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8 1073741824 Sep 29 16:44:18 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:18 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:18 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Flow 'volume_create_manager' (fa0604f8-c36e-48e8-a0aa-32f705c92e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:18 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3172daf0-cef0-40c9-88f0-67d4876d49f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:18 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3172daf0-cef0-40c9-88f0-67d4876d49f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1552151346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196457f6-924b-4b83-8599-2eebb6d3b807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a69283ede0422db8d06a16d2c8c7a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:18Z,use_quota=True,user_id='25f0231d38be4c8ca353b5073139414f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:18 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad0c9af-9890-43bd-bf67-2e8f7b529495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:18 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad0c9af-9890-43bd-bf67-2e8f7b529495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:18 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7001d3cb-18f2-4687-bd19-435ff8a6dbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:18 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7001d3cb-18f2-4687-bd19-435ff8a6dbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '196457f6-924b-4b83-8599-2eebb6d3b807', 'volume_name': 'volume-196457f6-924b-4b83-8599-2eebb6d3b807', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:18 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f966e88-b499-424d-8c2c-30cf4e24e7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:18 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f966e88-b499-424d-8c2c-30cf4e24e7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:18 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab7918c-54f3-44a8-b666-d82170d62630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:18 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Volume 196457f6-924b-4b83-8599-2eebb6d3b807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-196457f6-924b-4b83-8599-2eebb6d3b807', 'volume_size': 1} Sep 29 16:44:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:18 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8 1073741824" returned: 0 in 0.703s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:18 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8 Sep 29 16:44:18 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Flow 'volume_create_manager' (361d53d1-8713-407a-8786-2c28b67d963a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8139aa00-9f84-4a36-b126-1ba600923aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8139aa00-9f84-4a36-b126-1ba600923aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425640860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed7ce6f-1327-4c2b-8d29-37e6167bf657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a69283ede0422db8d06a16d2c8c7a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:19Z,use_quota=True,user_id='25f0231d38be4c8ca353b5073139414f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c8224b-8581-4818-97bb-a9b2f79163f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c8224b-8581-4818-97bb-a9b2f79163f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afdc07c-5724-41a3-bc32-311c67d0c8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9afdc07c-5724-41a3-bc32-311c67d0c8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed7ce6f-1327-4c2b-8d29-37e6167bf657', 'volume_name': 'volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a68b034-dd9d-4f20-a334-58f131551e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a68b034-dd9d-4f20-a334-58f131551e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb5e38f-0398-4b84-a9c0-cd1c4f435b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:19 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Volume 9ed7ce6f-1327-4c2b-8d29-37e6167bf657: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657', 'volume_size': 1} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:19 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8" returned: 0 in 0.430s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.802s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1552151346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196457f6-924b-4b83-8599-2eebb6d3b807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a69283ede0422db8d06a16d2c8c7a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:18Z,use_quota=True,user_id='25f0231d38be4c8ca353b5073139414f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Creating volume 196457f6-924b-4b83-8599-2eebb6d3b807 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:19 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-196457f6-924b-4b83-8599-2eebb6d3b807 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a64be08-127c-48ce-bfb6-7159358fef8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e308dc-b56c-4f25-a70e-386fc30b9344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:19 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-196457f6-924b-4b83-8599-2eebb6d3b807 1073741824 Sep 29 16:44:19 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:19 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Volume volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8 (e3e8648a-7138-4fbd-a06f-0f8c318d5cd8): created successfully Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e308dc-b56c-4f25-a70e-386fc30b9344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Flow 'volume_create_manager' (a22fc80f-b0fe-4fb2-8ccd-5c16b475ef3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:19 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-50fecedc-fb27-4261-a892-0bb5f03f8141 tempest-CreateVolumesFromImageTest-1502818253 None] Created volume successfully. Sep 29 16:44:19 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-196457f6-924b-4b83-8599-2eebb6d3b807 1073741824" returned: 0 in 0.736s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-196457f6-924b-4b83-8599-2eebb6d3b807 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Flow 'volume_create_manager' (14f603f3-51b3-4c6b-a510-5a8219ac046b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6c1ed4-60ad-4bf8-ac40-8e6df68c823e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:20 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-196457f6-924b-4b83-8599-2eebb6d3b807 Sep 29 16:44:20 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6c1ed4-60ad-4bf8-ac40-8e6df68c823e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1378188220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340b64cc-faa3-4979-8a46-47b9c9d1ccf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a69283ede0422db8d06a16d2c8c7a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:20Z,use_quota=True,user_id='25f0231d38be4c8ca353b5073139414f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a365360c-577c-44b7-bed8-76a4c3532cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a365360c-577c-44b7-bed8-76a4c3532cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac7b758-16a9-4286-b761-f1104af1a910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac7b758-16a9-4286-b761-f1104af1a910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '340b64cc-faa3-4979-8a46-47b9c9d1ccf3', 'volume_name': 'volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b3a174-6cd9-4329-8f65-79fa7b90f66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b3a174-6cd9-4329-8f65-79fa7b90f66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd53d6ad-3464-4fc7-a3df-7dd1fc73cede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:20 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Volume 340b64cc-faa3-4979-8a46-47b9c9d1ccf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3', 'volume_size': 1} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:20 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-196457f6-924b-4b83-8599-2eebb6d3b807" returned: 0 in 0.472s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.357s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425640860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed7ce6f-1327-4c2b-8d29-37e6167bf657,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a69283ede0422db8d06a16d2c8c7a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:19Z,use_quota=True,user_id='25f0231d38be4c8ca353b5073139414f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Creating volume 9ed7ce6f-1327-4c2b-8d29-37e6167bf657 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:20 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:20 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657 1073741824 Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab7918c-54f3-44a8-b666-d82170d62630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196457f6-924b-4b83-8599-2eebb6d3b807', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:20 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e6efcc-b59c-45e6-adbc-7ec04a08350b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:20 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Volume volume-196457f6-924b-4b83-8599-2eebb6d3b807 (196457f6-924b-4b83-8599-2eebb6d3b807): created successfully Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e6efcc-b59c-45e6-adbc-7ec04a08350b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Flow 'volume_create_manager' (fa0604f8-c36e-48e8-a0aa-32f705c92e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:20 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-83d8de59-9ea8-441f-9f9f-f0f2221ca35e tempest-CreateVolumesFromImageTest-1502818253 None] Created volume successfully. Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Flow 'volume_create_manager' (ab877faf-709b-49db-8a32-257b7ab49b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6858eb-201b-4ff4-bdf3-3e560f5f5efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6858eb-201b-4ff4-bdf3-3e560f5f5efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-930571628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00bc66bb-b061-4165-a4f8-38888a96c0a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a69283ede0422db8d06a16d2c8c7a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:21Z,use_quota=True,user_id='25f0231d38be4c8ca353b5073139414f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6019effb-2e01-4f30-929e-56263255bb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6019effb-2e01-4f30-929e-56263255bb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50648170-716b-40d7-b11b-6e7f00a489df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50648170-716b-40d7-b11b-6e7f00a489df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00bc66bb-b061-4165-a4f8-38888a96c0a8', 'volume_name': 'volume-00bc66bb-b061-4165-a4f8-38888a96c0a8', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6c41ea-955b-4660-990c-60595e2928f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc6c41ea-955b-4660-990c-60595e2928f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afbd200f-3a48-45d8-827b-66154e6c4c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:20 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Volume 00bc66bb-b061-4165-a4f8-38888a96c0a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00bc66bb-b061-4165-a4f8-38888a96c0a8', 'volume_size': 1} Sep 29 16:44:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:21 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657 1073741824" returned: 0 in 0.604s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:21 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657 Sep 29 16:44:21 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:21 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657" returned: 0 in 0.279s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.313s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1378188220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=340b64cc-faa3-4979-8a46-47b9c9d1ccf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a69283ede0422db8d06a16d2c8c7a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:20Z,use_quota=True,user_id='25f0231d38be4c8ca353b5073139414f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Creating volume 340b64cc-faa3-4979-8a46-47b9c9d1ccf3 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:21 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:21 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3 1073741824 Sep 29 16:44:21 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efb5e38f-0398-4b84-a9c0-cd1c4f435b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b9ff27-27eb-4020-9a9c-7a1c461bc861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:21 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Volume volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657 (9ed7ce6f-1327-4c2b-8d29-37e6167bf657): created successfully Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b9ff27-27eb-4020-9a9c-7a1c461bc861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Flow 'volume_create_manager' (361d53d1-8713-407a-8786-2c28b67d963a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:21 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-87ea38dd-ce63-4244-bfa9-ae357757dff8 tempest-CreateVolumesFromImageTest-1502818253 None] Created volume successfully. Sep 29 16:44:22 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3 1073741824" returned: 0 in 0.633s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:22 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3 Sep 29 16:44:22 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:22 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3" returned: 0 in 0.420s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.770s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-930571628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00bc66bb-b061-4165-a4f8-38888a96c0a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24a69283ede0422db8d06a16d2c8c7a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:21Z,use_quota=True,user_id='25f0231d38be4c8ca353b5073139414f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Creating volume 00bc66bb-b061-4165-a4f8-38888a96c0a8 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:22 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-00bc66bb-b061-4165-a4f8-38888a96c0a8 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:22 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-00bc66bb-b061-4165-a4f8-38888a96c0a8 1073741824 Sep 29 16:44:22 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd53d6ad-3464-4fc7-a3df-7dd1fc73cede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337a706d-a0b8-4259-8fb5-9f371f683913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:22 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Volume volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3 (340b64cc-faa3-4979-8a46-47b9c9d1ccf3): created successfully Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337a706d-a0b8-4259-8fb5-9f371f683913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Flow 'volume_create_manager' (14f603f3-51b3-4c6b-a510-5a8219ac046b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:22 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c11be4c1-61ec-4162-94a4-a7cc573b444c tempest-CreateVolumesFromImageTest-1502818253 None] Created volume successfully. Sep 29 16:44:23 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-00bc66bb-b061-4165-a4f8-38888a96c0a8 1073741824" returned: 0 in 0.608s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-00bc66bb-b061-4165-a4f8-38888a96c0a8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:23 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-00bc66bb-b061-4165-a4f8-38888a96c0a8 Sep 29 16:44:23 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:23 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-00bc66bb-b061-4165-a4f8-38888a96c0a8" returned: 0 in 0.307s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afbd200f-3a48-45d8-827b-66154e6c4c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00bc66bb-b061-4165-a4f8-38888a96c0a8', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8919b0b1-7627-4b95-9c6e-aaaf890cdf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:23 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Volume volume-00bc66bb-b061-4165-a4f8-38888a96c0a8 (00bc66bb-b061-4165-a4f8-38888a96c0a8): created successfully Sep 29 16:44:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8919b0b1-7627-4b95-9c6e-aaaf890cdf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Flow 'volume_create_manager' (ab877faf-709b-49db-8a32-257b7ab49b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:23 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-8bdd4dd7-8004-445e-ac51-6c5412efd839 tempest-CreateVolumesFromImageTest-1502818253 None] Created volume successfully. Sep 29 16:44:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "cinder-00bc66bb-b061-4165-a4f8-38888a96c0a8-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-00bc66bb-b061-4165-a4f8-38888a96c0a8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "cinder-quobyte-00bc66bb-b061-4165-a4f8-38888a96c0a8" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-quobyte-00bc66bb-b061-4165-a4f8-38888a96c0a8" acquired by "delete_volume" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:24 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a36cbdb-c23e-44e3-b2b9-720182cddbdc]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-00bc66bb-b061-4165-a4f8-38888a96c0a8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:24 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-00bc66bb-b061-4165-a4f8-38888a96c0a8 Sep 29 16:44:24 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:24 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-00bc66bb-b061-4165-a4f8-38888a96c0a8" returned: 0 in 0.553s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-00bc66bb-b061-4165-a4f8-38888a96c0a8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:24 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-00bc66bb-b061-4165-a4f8-38888a96c0a8 Sep 29 16:44:24 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:25 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-00bc66bb-b061-4165-a4f8-38888a96c0a8" returned: 0 in 0.362s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-quobyte-00bc66bb-b061-4165-a4f8-38888a96c0a8" released by "delete_volume" :: held 0.984s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:25 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Created reservations ['ab9a4ccb-e53f-4266-a2b9-eadbbcc6fe88', 'e6385421-0516-4974-8f9e-2cb40151a4ad', '183ef889-ceff-4344-9ad3-a94fc67cb024', '347027fc-7f26-45e5-bc40-1b7f1d0df575'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:25 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:25 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:25 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.369s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:25 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:25 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Deleted volume successfully. Sep 29 16:44:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-af40c721-6608-4271-b343-973cbf3c4871 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-00bc66bb-b061-4165-a4f8-38888a96c0a8-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "cinder-340b64cc-faa3-4979-8a46-47b9c9d1ccf3-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-340b64cc-faa3-4979-8a46-47b9c9d1ccf3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "cinder-quobyte-340b64cc-faa3-4979-8a46-47b9c9d1ccf3" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-quobyte-340b64cc-faa3-4979-8a46-47b9c9d1ccf3" acquired by "delete_volume" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:26 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a0d418-9e78-4047-ad67-9ecd116adc57]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:26 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3 Sep 29 16:44:26 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:27 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3" returned: 0 in 0.511s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:27 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3 Sep 29 16:44:27 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:27 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-340b64cc-faa3-4979-8a46-47b9c9d1ccf3" returned: 0 in 0.284s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-quobyte-340b64cc-faa3-4979-8a46-47b9c9d1ccf3" released by "delete_volume" :: held 0.858s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Created reservations ['4de984ac-18fb-4300-b96f-bb41fbcb314c', '63e3f953-1e95-44c2-a09a-f7775cd732a0', '51822b1f-fabd-4f28-a1b8-0e4198eb1bd1', '7602ef75-6929-49af-b6ba-f7c2157847bd'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:27 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:27 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "cinder-9ed7ce6f-1327-4c2b-8d29-37e6167bf657-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-9ed7ce6f-1327-4c2b-8d29-37e6167bf657-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "cinder-quobyte-9ed7ce6f-1327-4c2b-8d29-37e6167bf657" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-quobyte-9ed7ce6f-1327-4c2b-8d29-37e6167bf657" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:28 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[33434244-6e25-48a9-9729-de3217be0462]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:28 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.386s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:28 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:28 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Deleted volume successfully. Sep 29 16:44:28 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657 Sep 29 16:44:28 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c1115adf-28eb-4dde-9aad-24f226866b09 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-340b64cc-faa3-4979-8a46-47b9c9d1ccf3-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:28 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657" returned: 0 in 0.531s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:28 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657 Sep 29 16:44:28 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:28 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9ed7ce6f-1327-4c2b-8d29-37e6167bf657" returned: 0 in 0.331s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-quobyte-9ed7ce6f-1327-4c2b-8d29-37e6167bf657" released by "delete_volume" :: held 0.926s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:28 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Created reservations ['fa817d02-e0f1-4311-86cb-8c043694ad78', '3adefc29-8254-4f7a-b8d5-91bad08e4c1f', 'ed8a486a-e17b-4dd7-9057-c75d84c93851', '8b2e137b-89ec-4d79-af67-4a03efdd8c4f'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:29 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:29 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:29 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:29 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:29 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.354s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:29 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:29 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Deleted volume successfully. Sep 29 16:44:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-22ce5254-ef81-47b0-bda5-e2026efcaef4 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-9ed7ce6f-1327-4c2b-8d29-37e6167bf657-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "cinder-196457f6-924b-4b83-8599-2eebb6d3b807-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-196457f6-924b-4b83-8599-2eebb6d3b807-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "cinder-quobyte-196457f6-924b-4b83-8599-2eebb6d3b807" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-quobyte-196457f6-924b-4b83-8599-2eebb6d3b807" acquired by "delete_volume" :: waited 0.028s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:30 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edfe43b-78d1-4a98-b451-e64f200fb30c]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-196457f6-924b-4b83-8599-2eebb6d3b807 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:30 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-196457f6-924b-4b83-8599-2eebb6d3b807 Sep 29 16:44:30 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:30 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-196457f6-924b-4b83-8599-2eebb6d3b807" returned: 0 in 0.566s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-196457f6-924b-4b83-8599-2eebb6d3b807 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:30 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-196457f6-924b-4b83-8599-2eebb6d3b807 Sep 29 16:44:30 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:31 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-196457f6-924b-4b83-8599-2eebb6d3b807" returned: 0 in 0.385s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-quobyte-196457f6-924b-4b83-8599-2eebb6d3b807" released by "delete_volume" :: held 1.023s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Created reservations ['a235c611-2f2f-46a3-a202-35ceb7419611', '75ef9644-e929-411a-985e-7fe8f6ebcd54', 'a71ed9e5-ea14-4f95-8c8f-2b64c9060a98', '43016b79-d1a8-4e94-b5e7-dd00ccc76140'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:31 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Flow 'volume_create_manager' (87bedda4-85ee-46bb-9c1c-154edef34b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:31 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59602039-a2b0-417e-9ac4-10a67026a7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59602039-a2b0-417e-9ac4-10a67026a7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1904079877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e421165-3ba9-40ef-9c63-b2acb3a99022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeeca3a632a4180821e17e0679c62fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:31Z,use_quota=True,user_id='46253c7ea90942f1b6384614a9989654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d145fde-8f40-4279-a031-0d7c061ee25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d145fde-8f40-4279-a031-0d7c061ee25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4549ccfb-2d62-4a66-b567-494b29d38353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4549ccfb-2d62-4a66-b567-494b29d38353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e421165-3ba9-40ef-9c63-b2acb3a99022', 'volume_name': 'volume-5e421165-3ba9-40ef-9c63-b2acb3a99022', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69577937-5ff9-40ca-818f-8b1fc5f36963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69577937-5ff9-40ca-818f-8b1fc5f36963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f77e97-83ae-4013-ab12-d7a3dbfc7d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:31 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume 5e421165-3ba9-40ef-9c63-b2acb3a99022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e421165-3ba9-40ef-9c63-b2acb3a99022', 'volume_size': 1} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1904079877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e421165-3ba9-40ef-9c63-b2acb3a99022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeeca3a632a4180821e17e0679c62fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:31Z,use_quota=True,user_id='46253c7ea90942f1b6384614a9989654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Creating volume 5e421165-3ba9-40ef-9c63-b2acb3a99022 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:31 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5e421165-3ba9-40ef-9c63-b2acb3a99022 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:31 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5e421165-3ba9-40ef-9c63-b2acb3a99022 1073741824 Sep 29 16:44:31 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:31 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.353s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:31 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Deleted volume successfully. Sep 29 16:44:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-741c1d57-757f-4b3a-aeba-eca201563dae tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-196457f6-924b-4b83-8599-2eebb6d3b807-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:32 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5e421165-3ba9-40ef-9c63-b2acb3a99022 1073741824" returned: 0 in 0.603s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5e421165-3ba9-40ef-9c63-b2acb3a99022 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:32 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5e421165-3ba9-40ef-9c63-b2acb3a99022 Sep 29 16:44:32 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "cinder-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "cinder-quobyte-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-quobyte-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:32 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5e421165-3ba9-40ef-9c63-b2acb3a99022" returned: 0 in 0.468s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f77e97-83ae-4013-ab12-d7a3dbfc7d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e421165-3ba9-40ef-9c63-b2acb3a99022', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdd9961-3e4d-44e4-9e3e-d0f54780e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d27706c-8744-4cf2-9677-3332148d3d98]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:32 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume volume-5e421165-3ba9-40ef-9c63-b2acb3a99022 (5e421165-3ba9-40ef-9c63-b2acb3a99022): created successfully Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdd9961-3e4d-44e4-9e3e-d0f54780e041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Flow 'volume_create_manager' (87bedda4-85ee-46bb-9c1c-154edef34b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:32 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c6ac26b0-225e-4055-a7a4-ef65f45a26d2 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Created volume successfully. Sep 29 16:44:32 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8 Sep 29 16:44:32 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:33 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8" returned: 0 in 0.437s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:33 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8 Sep 29 16:44:33 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:33 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8" returned: 0 in 0.337s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-quobyte-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8" released by "delete_volume" :: held 0.853s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:33 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Created reservations ['65853c08-f98b-4cef-8cc4-e049a8413530', 'd8b56f31-5143-4f53-b347-d0384abd096e', 'b3f9a072-77b0-44b6-9e09-db69a0154e86', '487ff21f-2bb4-4a80-8605-52150dcff4af'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:33 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:33 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:34 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.408s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:34 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Deleted volume successfully. Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Flow 'volume_create_manager' (98f47ea5-e79c-46e6-ada1-616d1c2a2c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26753b89-8f94-4e19-b0d9-bf0c64b10d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-33a90b1a-7421-4670-942c-3fba3f72a943 tempest-CreateVolumesFromImageTest-1502818253 None] Lock "cinder-e3e8648a-7138-4fbd-a06f-0f8c318d5cd8-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26753b89-8f94-4e19-b0d9-bf0c64b10d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656005709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c30ed7-78df-480c-9107-c6220b866538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeeca3a632a4180821e17e0679c62fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:34Z,use_quota=True,user_id='46253c7ea90942f1b6384614a9989654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7342f6ff-d283-4243-9e95-7a2205ae194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7342f6ff-d283-4243-9e95-7a2205ae194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bc7e0f-b74a-4720-8bca-bf5c86356b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4bc7e0f-b74a-4720-8bca-bf5c86356b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01c30ed7-78df-480c-9107-c6220b866538', 'volume_name': 'volume-01c30ed7-78df-480c-9107-c6220b866538', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1025d4-ff41-444b-beef-79f17be3c71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1025d4-ff41-444b-beef-79f17be3c71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728583ef-392f-4065-a345-787d20cf48c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:34 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume 01c30ed7-78df-480c-9107-c6220b866538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01c30ed7-78df-480c-9107-c6220b866538', 'volume_size': 1} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656005709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c30ed7-78df-480c-9107-c6220b866538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeeca3a632a4180821e17e0679c62fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:34Z,use_quota=True,user_id='46253c7ea90942f1b6384614a9989654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Creating volume 01c30ed7-78df-480c-9107-c6220b866538 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:34 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-01c30ed7-78df-480c-9107-c6220b866538 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:34 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-01c30ed7-78df-480c-9107-c6220b866538 1073741824 Sep 29 16:44:34 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:34 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:34 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Flow 'volume_create_manager' (a91cdb89-4616-42b9-b080-317d9cf465b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce8b73e-fbf8-46a3-a9e3-d68e90d3cba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce8b73e-fbf8-46a3-a9e3-d68e90d3cba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2017562302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1194a62-6d36-4ef6-9e35-cea0efaadcd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeeca3a632a4180821e17e0679c62fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:35Z,use_quota=True,user_id='46253c7ea90942f1b6384614a9989654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162a9b62-5c24-47c1-a215-979d8b9f161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162a9b62-5c24-47c1-a215-979d8b9f161f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4734989-7b72-42a0-acdd-c7afb434183f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4734989-7b72-42a0-acdd-c7afb434183f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1194a62-6d36-4ef6-9e35-cea0efaadcd2', 'volume_name': 'volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cf1af8-ef44-45c9-99fb-942e1357987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cf1af8-ef44-45c9-99fb-942e1357987a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957fc399-1297-47f9-8b0b-ee26dae0ebab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:35 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume e1194a62-6d36-4ef6-9e35-cea0efaadcd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2', 'volume_size': 1} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:35 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.451s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:44:35 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-01c30ed7-78df-480c-9107-c6220b866538 1073741824" returned: 0 in 0.862s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-01c30ed7-78df-480c-9107-c6220b866538 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:35 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-01c30ed7-78df-480c-9107-c6220b866538 Sep 29 16:44:35 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Flow 'volume_create_manager' (7805bdef-6f54-4c21-887a-7394bfb9da8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d71fba-acf7-491f-9007-4f2f52b9bc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d71fba-acf7-491f-9007-4f2f52b9bc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-886052069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4708b205-1049-4631-a300-85e8911bc128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeeca3a632a4180821e17e0679c62fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:36Z,use_quota=True,user_id='46253c7ea90942f1b6384614a9989654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444973c9-31c5-4539-b33f-737a10afc20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444973c9-31c5-4539-b33f-737a10afc20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:35 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298689ba-a900-46f6-8009-bb05b83a592c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298689ba-a900-46f6-8009-bb05b83a592c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4708b205-1049-4631-a300-85e8911bc128', 'volume_name': 'volume-4708b205-1049-4631-a300-85e8911bc128', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9146f6bc-22c2-4a77-879a-362fe27e7fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9146f6bc-22c2-4a77-879a-362fe27e7fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4666a8a-9b0e-4946-967f-c5d17ac9d870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:35 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume 4708b205-1049-4631-a300-85e8911bc128: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4708b205-1049-4631-a300-85e8911bc128', 'volume_size': 1} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-01c30ed7-78df-480c-9107-c6220b866538" returned: 0 in 0.558s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.709s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2017562302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1194a62-6d36-4ef6-9e35-cea0efaadcd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeeca3a632a4180821e17e0679c62fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:35Z,use_quota=True,user_id='46253c7ea90942f1b6384614a9989654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Creating volume e1194a62-6d36-4ef6-9e35-cea0efaadcd2 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:35 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (728583ef-392f-4065-a345-787d20cf48c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01c30ed7-78df-480c-9107-c6220b866538', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d64d6a-6c0a-4054-b42a-7e613d189cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:36 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2 1073741824 Sep 29 16:44:36 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:36 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume volume-01c30ed7-78df-480c-9107-c6220b866538 (01c30ed7-78df-480c-9107-c6220b866538): created successfully Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d64d6a-6c0a-4054-b42a-7e613d189cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Flow 'volume_create_manager' (98f47ea5-e79c-46e6-ada1-616d1c2a2c61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:36 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-6aa52226-702d-46a9-af21-fceafc25ea88 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Created volume successfully. Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Flow 'volume_create_manager' (5d3cefea-4bd3-47ca-b321-c2e24963247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729f8be8-91f1-467a-ade5-ecdd8626cdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729f8be8-91f1-467a-ade5-ecdd8626cdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-491528445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b7cbf1-2d7c-455c-a56a-b8538404db66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeeca3a632a4180821e17e0679c62fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:36Z,use_quota=True,user_id='46253c7ea90942f1b6384614a9989654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e0875b5-c17a-4eb8-a8aa-969184459774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e0875b5-c17a-4eb8-a8aa-969184459774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0cbd77b-fa2b-4ba4-9a14-7a04b9b46e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0cbd77b-fa2b-4ba4-9a14-7a04b9b46e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b7cbf1-2d7c-455c-a56a-b8538404db66', 'volume_name': 'volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fbe56bb-2f1a-4316-9a99-7b8b53150a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fbe56bb-2f1a-4316-9a99-7b8b53150a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4905c15-e66b-4e15-8c8f-229ceb3822c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:36 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume b6b7cbf1-2d7c-455c-a56a-b8538404db66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66', 'volume_size': 1} Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:36 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2 1073741824" returned: 0 in 0.830s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:36 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2 Sep 29 16:44:36 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Flow 'volume_create_manager' (72866b83-9eea-4130-8c14-3d22b3732630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b414294-e936-49b6-bc51-04630b2c4a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b414294-e936-49b6-bc51-04630b2c4a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2138511425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bb6d41-e9b0-41af-8fc0-2919a4fa84be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeeca3a632a4180821e17e0679c62fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:37Z,use_quota=True,user_id='46253c7ea90942f1b6384614a9989654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39c711b-fed6-4ba6-b778-8b5fbd3e5569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a39c711b-fed6-4ba6-b778-8b5fbd3e5569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f60fa9-26a7-4588-a463-287d9bfb4cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:37 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f60fa9-26a7-4588-a463-287d9bfb4cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87bb6d41-e9b0-41af-8fc0-2919a4fa84be', 'volume_name': 'volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454ca40b-faed-4483-b777-cdd919b40db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454ca40b-faed-4483-b777-cdd919b40db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae74c63-8c09-4ca2-8b83-3c84d4f4154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:37 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume 87bb6d41-e9b0-41af-8fc0-2919a4fa84be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be', 'volume_size': 1} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2" returned: 0 in 0.402s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.303s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-886052069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4708b205-1049-4631-a300-85e8911bc128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeeca3a632a4180821e17e0679c62fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:36Z,use_quota=True,user_id='46253c7ea90942f1b6384614a9989654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Creating volume 4708b205-1049-4631-a300-85e8911bc128 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:37 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4708b205-1049-4631-a300-85e8911bc128 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957fc399-1297-47f9-8b0b-ee26dae0ebab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0914d0ef-6efc-4cbd-836a-bef3939cf566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:37 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4708b205-1049-4631-a300-85e8911bc128 1073741824 Sep 29 16:44:37 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:37 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2 (e1194a62-6d36-4ef6-9e35-cea0efaadcd2): created successfully Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0914d0ef-6efc-4cbd-836a-bef3939cf566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Flow 'volume_create_manager' (a91cdb89-4616-42b9-b080-317d9cf465b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:37 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-183ccc1a-023a-4fc6-9ac0-d6be7e93bac1 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Created volume successfully. Sep 29 16:44:37 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4708b205-1049-4631-a300-85e8911bc128 1073741824" returned: 0 in 0.568s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4708b205-1049-4631-a300-85e8911bc128 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:37 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4708b205-1049-4631-a300-85e8911bc128 Sep 29 16:44:37 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:38 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4708b205-1049-4631-a300-85e8911bc128" returned: 0 in 0.298s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.569s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-491528445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b7cbf1-2d7c-455c-a56a-b8538404db66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeeca3a632a4180821e17e0679c62fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:36Z,use_quota=True,user_id='46253c7ea90942f1b6384614a9989654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Creating volume b6b7cbf1-2d7c-455c-a56a-b8538404db66 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:38 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4666a8a-9b0e-4946-967f-c5d17ac9d870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4708b205-1049-4631-a300-85e8911bc128', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4a4ce5-a1ac-4483-880c-4ef2f9bdae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:38 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66 1073741824 Sep 29 16:44:38 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:38 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume volume-4708b205-1049-4631-a300-85e8911bc128 (4708b205-1049-4631-a300-85e8911bc128): created successfully Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4a4ce5-a1ac-4483-880c-4ef2f9bdae41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Flow 'volume_create_manager' (7805bdef-6f54-4c21-887a-7394bfb9da8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:38 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7ea12a25-3e15-4be3-839b-d793e9296875 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Created volume successfully. Sep 29 16:44:38 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66 1073741824" returned: 0 in 0.714s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:38 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66 Sep 29 16:44:38 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:39 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66" returned: 0 in 0.404s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.124s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2138511425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bb6d41-e9b0-41af-8fc0-2919a4fa84be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdeeca3a632a4180821e17e0679c62fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:37Z,use_quota=True,user_id='46253c7ea90942f1b6384614a9989654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Creating volume 87bb6d41-e9b0-41af-8fc0-2919a4fa84be {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:39 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4905c15-e66b-4e15-8c8f-229ceb3822c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:39 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be 1073741824 Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc742b35-565f-4d85-a6c7-01410f1462fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:39 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:39 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66 (b6b7cbf1-2d7c-455c-a56a-b8538404db66): created successfully Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc742b35-565f-4d85-a6c7-01410f1462fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Flow 'volume_create_manager' (5d3cefea-4bd3-47ca-b321-c2e24963247b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:39 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f5e30e27-f0e7-4e0c-9864-dc58bae0a099 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Created volume successfully. Sep 29 16:44:40 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be 1073741824" returned: 0 in 0.787s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:40 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be Sep 29 16:44:40 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:40 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be" returned: 0 in 0.570s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:40 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:40 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae74c63-8c09-4ca2-8b83-3c84d4f4154b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:40 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60fd50d-1e04-4607-a23e-51c9b21fd9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:40 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Volume volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be (87bb6d41-e9b0-41af-8fc0-2919a4fa84be): created successfully Sep 29 16:44:40 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d60fd50d-1e04-4607-a23e-51c9b21fd9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:40 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Flow 'volume_create_manager' (72866b83-9eea-4130-8c14-3d22b3732630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:40 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-dd3e39ca-9d1f-4dc8-a83d-a67354732402 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Created volume successfully. Sep 29 16:44:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "cinder-87bb6d41-e9b0-41af-8fc0-2919a4fa84be-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-87bb6d41-e9b0-41af-8fc0-2919a4fa84be-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "cinder-quobyte-87bb6d41-e9b0-41af-8fc0-2919a4fa84be" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-quobyte-87bb6d41-e9b0-41af-8fc0-2919a4fa84be" acquired by "delete_volume" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:42 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1684d1-0eab-4a6e-8785-1e223583dcb9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:42 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be Sep 29 16:44:42 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:42 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be" returned: 0 in 0.573s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:42 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be Sep 29 16:44:42 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:43 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-87bb6d41-e9b0-41af-8fc0-2919a4fa84be" returned: 0 in 0.313s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-quobyte-87bb6d41-e9b0-41af-8fc0-2919a4fa84be" released by "delete_volume" :: held 0.958s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:43 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Created reservations ['f7264b6f-7aca-437a-ad5d-1e65adc7bfd0', 'c65901be-86c2-4faf-bd8d-9d96526f4995', '21849ff4-effb-4f09-bad4-c7428dbf80e9', 'de1b4163-2ed0-4950-943b-f4aa83161442'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:43 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:43 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:43 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.325s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:43 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:43 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Deleted volume successfully. Sep 29 16:44:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7ef93730-7586-423e-8f00-6deed8e5c824 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-87bb6d41-e9b0-41af-8fc0-2919a4fa84be-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "cinder-b6b7cbf1-2d7c-455c-a56a-b8538404db66-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-b6b7cbf1-2d7c-455c-a56a-b8538404db66-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "cinder-quobyte-b6b7cbf1-2d7c-455c-a56a-b8538404db66" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-quobyte-b6b7cbf1-2d7c-455c-a56a-b8538404db66" acquired by "delete_volume" :: waited 0.034s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:44 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa320bfe-48d0-4e5b-8e11-9fc364d398e6]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:44 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66 Sep 29 16:44:44 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:45 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66" returned: 0 in 0.529s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:45 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66 Sep 29 16:44:45 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:45 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b6b7cbf1-2d7c-455c-a56a-b8538404db66" returned: 0 in 0.332s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-quobyte-b6b7cbf1-2d7c-455c-a56a-b8538404db66" released by "delete_volume" :: held 0.939s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:45 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:DELETE=16,cinder:SELECT=115,cinder:UPDATE=148,cinder:INSERT=46 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:44:45 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Created reservations ['0bd1dbc8-7e71-47a4-9a9c-0b769330c761', '50dd9215-9c7e-4808-8825-b60bf2b8d9b6', '6026c830-faa6-462b-a285-e036c2929486', '2f37d7a5-7a70-4177-870b-50db2e81c6a5'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:45 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:45 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:46 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.348s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:46 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:46 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Deleted volume successfully. Sep 29 16:44:46 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee3ac434-48f7-4d67-9bdb-d462781df178 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-b6b7cbf1-2d7c-455c-a56a-b8538404db66-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:46 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "cinder-4708b205-1049-4631-a300-85e8911bc128-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:46 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-4708b205-1049-4631-a300-85e8911bc128-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:46 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "cinder-quobyte-4708b205-1049-4631-a300-85e8911bc128" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:46 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-quobyte-4708b205-1049-4631-a300-85e8911bc128" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:46 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf720b82-d72b-438a-a7bc-2ec3a23988a3]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4708b205-1049-4631-a300-85e8911bc128 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:47 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4708b205-1049-4631-a300-85e8911bc128 Sep 29 16:44:47 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:47 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4708b205-1049-4631-a300-85e8911bc128" returned: 0 in 0.465s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4708b205-1049-4631-a300-85e8911bc128 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:47 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4708b205-1049-4631-a300-85e8911bc128 Sep 29 16:44:47 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:47 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4708b205-1049-4631-a300-85e8911bc128" returned: 0 in 0.330s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-quobyte-4708b205-1049-4631-a300-85e8911bc128" released by "delete_volume" :: held 0.877s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:47 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Created reservations ['a762307f-7c21-4b41-94a8-ce259959e747', 'ee57216d-b164-416d-9c43-79d0f624265d', '5b2cd5d1-b3e8-4cbe-89a5-af5a6f73cc9f', '32ba0f89-7eb6-4503-91b5-890e3291032b'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:47 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:47 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "cinder-e1194a62-6d36-4ef6-9e35-cea0efaadcd2-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-e1194a62-6d36-4ef6-9e35-cea0efaadcd2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "cinder-quobyte-e1194a62-6d36-4ef6-9e35-cea0efaadcd2" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-quobyte-e1194a62-6d36-4ef6-9e35-cea0efaadcd2" acquired by "delete_volume" :: waited 0.046s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:48 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:48 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9a2b3f-7446-42f2-8c49-81054798c9d0]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.418s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:48 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:48 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Deleted volume successfully. Sep 29 16:44:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-13563410-cc05-45b2-a2e0-aaa252747c85 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-4708b205-1049-4631-a300-85e8911bc128-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:48 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2 Sep 29 16:44:48 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:48 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2" returned: 0 in 0.487s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:48 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2 Sep 29 16:44:48 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:49 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e1194a62-6d36-4ef6-9e35-cea0efaadcd2" returned: 0 in 0.353s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-quobyte-e1194a62-6d36-4ef6-9e35-cea0efaadcd2" released by "delete_volume" :: held 0.929s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:49 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Created reservations ['45613e53-4b04-412e-ab9d-2de2c91f3e5c', 'd451d516-30c7-4b03-a131-7447c03a42d8', '41a3da7b-57ba-4482-9ab0-8ddc7289c934', 'cff80800-97af-4de0-b91e-45a3a1f20e74'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:49 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:49 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:49 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.327s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:49 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:49 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Deleted volume successfully. Sep 29 16:44:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-749e06bf-3ea4-4568-a859-0776a01f43be tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-e1194a62-6d36-4ef6-9e35-cea0efaadcd2-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "cinder-01c30ed7-78df-480c-9107-c6220b866538-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-01c30ed7-78df-480c-9107-c6220b866538-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "cinder-quobyte-01c30ed7-78df-480c-9107-c6220b866538" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-quobyte-01c30ed7-78df-480c-9107-c6220b866538" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:50 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[761976a8-2320-4fdf-a748-f5a7c85a8187]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-01c30ed7-78df-480c-9107-c6220b866538 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:50 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-01c30ed7-78df-480c-9107-c6220b866538 Sep 29 16:44:50 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:51 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-01c30ed7-78df-480c-9107-c6220b866538" returned: 0 in 0.370s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-01c30ed7-78df-480c-9107-c6220b866538 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:51 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-01c30ed7-78df-480c-9107-c6220b866538 Sep 29 16:44:51 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:51 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-01c30ed7-78df-480c-9107-c6220b866538" returned: 0 in 0.273s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-quobyte-01c30ed7-78df-480c-9107-c6220b866538" released by "delete_volume" :: held 0.690s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Created reservations ['5e36a188-d439-4a1a-a6f6-5247f0036098', '4b4d1710-924e-42b5-ae62-eec1f5bcfd52', '4fda21b8-29b1-45d5-97ca-8a87253fd85f', '1b0ecc76-1cab-4fb0-a60f-637ee1a41f64'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:51 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:51 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:51 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.269s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:51 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Deleted volume successfully. Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-8e4394ed-1f19-4c3f-b6ba-9373cca35fdb tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-01c30ed7-78df-480c-9107-c6220b866538-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "cinder-5e421165-3ba9-40ef-9c63-b2acb3a99022-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-5e421165-3ba9-40ef-9c63-b2acb3a99022-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "cinder-quobyte-5e421165-3ba9-40ef-9c63-b2acb3a99022" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-quobyte-5e421165-3ba9-40ef-9c63-b2acb3a99022" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2065ae-8bc4-4c1a-985c-04133d5fd321]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:44:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5e421165-3ba9-40ef-9c63-b2acb3a99022 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:52 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5e421165-3ba9-40ef-9c63-b2acb3a99022 Sep 29 16:44:52 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:52 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5e421165-3ba9-40ef-9c63-b2acb3a99022" returned: 0 in 0.599s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5e421165-3ba9-40ef-9c63-b2acb3a99022 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:52 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5e421165-3ba9-40ef-9c63-b2acb3a99022 Sep 29 16:44:52 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:52 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-5e421165-3ba9-40ef-9c63-b2acb3a99022" returned: 0 in 0.254s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-quobyte-5e421165-3ba9-40ef-9c63-b2acb3a99022" released by "delete_volume" :: held 0.935s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:52 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Created reservations ['f1fdd725-7c50-420b-8db5-902c4ee2c073', '54cce949-3242-4a06-9ba0-601e84f37e5c', '6e1bdb02-5b03-49f3-98fe-050e520c03f3', 'ada7b9f3-ca52-4e42-974e-f2be9d25992e'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:44:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:53 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:44:53 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:53 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.274s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:53 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:44:53 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Deleted volume successfully. Sep 29 16:44:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f55242b8-a58c-4ed9-bcc8-b4d19f3fdad5 tempest-CreateVolumesFromSourceVolumeTest-373181742 None] Lock "cinder-5e421165-3ba9-40ef-9c63-b2acb3a99022-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Flow 'volume_create_manager' (61a73b12-0815-41da-a963-7e48b82709e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b4dd09-50aa-4e78-9220-94f59b3d5efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b4dd09-50aa-4e78-9220-94f59b3d5efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2106363416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6feeaccc-77eb-443c-b29a-c2cfc03e4742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91654f82510944ebb3b4d0b3088614e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:57Z,use_quota=True,user_id='1b7f3ced8a64415aad81001ead80ab6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7b10fae-0242-4b47-9f9e-2eff9f3689bd),volume_type_id=e7b10fae-0242-4b47-9f9e-2eff9f3689bd)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245f0370-f347-4afa-8a50-e8c661efc2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (245f0370-f347-4afa-8a50-e8c661efc2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31ea290-a116-49c0-9748-d23f2d55c9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31ea290-a116-49c0-9748-d23f2d55c9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6feeaccc-77eb-443c-b29a-c2cfc03e4742', 'volume_name': 'volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e514d6bb-ca26-4824-afff-f979dbe52fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e514d6bb-ca26-4824-afff-f979dbe52fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ce046c-36ff-4bc1-a317-8340ece7281c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:56 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Volume 6feeaccc-77eb-443c-b29a-c2cfc03e4742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742', 'volume_size': 1} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2106363416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6feeaccc-77eb-443c-b29a-c2cfc03e4742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91654f82510944ebb3b4d0b3088614e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:57Z,use_quota=True,user_id='1b7f3ced8a64415aad81001ead80ab6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7b10fae-0242-4b47-9f9e-2eff9f3689bd),volume_type_id=e7b10fae-0242-4b47-9f9e-2eff9f3689bd)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Creating volume 6feeaccc-77eb-443c-b29a-c2cfc03e4742 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:56 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:56 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742 1073741824 Sep 29 16:44:56 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Flow 'volume_create_manager' (958ef466-c864-4a0d-b84c-44c2ed6911f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade17069-6a3a-4bfc-99aa-ee40c4377764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ade17069-6a3a-4bfc-99aa-ee40c4377764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-813615257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5ce088-fccd-41af-b0e5-c92cf32d89e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91654f82510944ebb3b4d0b3088614e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:57Z,use_quota=True,user_id='1b7f3ced8a64415aad81001ead80ab6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d18b672-9a49-4e31-a47d-bdf9f19222ea),volume_type_id=1d18b672-9a49-4e31-a47d-bdf9f19222ea)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56805d43-127f-4947-9366-9669dc267f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56805d43-127f-4947-9366-9669dc267f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6fd831-d44c-4a4f-b8df-5965c5672bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6fd831-d44c-4a4f-b8df-5965c5672bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e5ce088-fccd-41af-b0e5-c92cf32d89e6', 'volume_name': 'volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28d8c20-b0d3-4373-b637-3b6b64e70734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28d8c20-b0d3-4373-b637-3b6b64e70734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3bca1d6-9ac6-45f1-bae2-1a4ad56abaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:57 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Volume 7e5ce088-fccd-41af-b0e5-c92cf32d89e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6', 'volume_size': 1} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:57 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742 1073741824" returned: 0 in 0.558s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:57 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742 Sep 29 16:44:57 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:57 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742" returned: 0 in 0.362s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.525s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-813615257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e5ce088-fccd-41af-b0e5-c92cf32d89e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91654f82510944ebb3b4d0b3088614e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:57Z,use_quota=True,user_id='1b7f3ced8a64415aad81001ead80ab6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d18b672-9a49-4e31-a47d-bdf9f19222ea),volume_type_id=1d18b672-9a49-4e31-a47d-bdf9f19222ea)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Creating volume 7e5ce088-fccd-41af-b0e5-c92cf32d89e6 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:57 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ce046c-36ff-4bc1-a317-8340ece7281c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:57 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6 1073741824 Sep 29 16:44:57 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcff592-b29e-400a-80be-cb7f7ff0837c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:57 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Volume volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742 (6feeaccc-77eb-443c-b29a-c2cfc03e4742): created successfully Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcff592-b29e-400a-80be-cb7f7ff0837c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Flow 'volume_create_manager' (61a73b12-0815-41da-a963-7e48b82709e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-86d5a68a-40c6-4be2-ad1a-d2b479616662 tempest-TestInstancesWithCinderVolumes-49409961 None] Created volume successfully. Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Flow 'volume_create_manager' (e1a65601-fafd-4c0c-9b79-0fc1f46d5e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37dcfa1-fcfb-48ce-9897-c41ad11b9243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37dcfa1-fcfb-48ce-9897-c41ad11b9243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1871507045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6dbc44e-c386-4c0f-a5f5-f0cae0008437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c852fca1b54801b9f47e20ea5d7545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:58Z,use_quota=True,user_id='4192aecdd17c4f3caf3bedb75fee820b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebd109b-20a2-4fc9-9322-9c045d685011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ebd109b-20a2-4fc9-9322-9c045d685011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd27be0-591c-4ae1-a669-b61e45541c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd27be0-591c-4ae1-a669-b61e45541c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6dbc44e-c386-4c0f-a5f5-f0cae0008437', 'volume_name': 'volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:58 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42318b6-e4cd-4578-88db-1aca47f8fa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b42318b6-e4cd-4578-88db-1aca47f8fa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f3bec8-954f-4fb2-90aa-dd060a67f8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:58 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Volume c6dbc44e-c386-4c0f-a5f5-f0cae0008437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437', 'volume_size': 1} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6 1073741824" returned: 0 in 0.502s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Flow 'volume_create_manager' (88ba81c6-cd36-4a3b-bc9f-39aaae773096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da5196c-bc84-43d6-9daf-ee3664e50bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6da5196c-bc84-43d6-9daf-ee3664e50bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1779225007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c6b74f-0fff-4bc2-92f2-8a135a218d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91654f82510944ebb3b4d0b3088614e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:58Z,use_quota=True,user_id='1b7f3ced8a64415aad81001ead80ab6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15b943df-8be4-4ad7-bbeb-939c2352cdaf),volume_type_id=15b943df-8be4-4ad7-bbeb-939c2352cdaf)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c0feee-c8e7-449f-9b99-f1dfaf8e927f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09c0feee-c8e7-449f-9b99-f1dfaf8e927f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3acf512c-d80e-45d2-9bca-9974e8a6e6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.image.glance [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Creating Keystone auth plugin from conf {{(pid=86793) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:58 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6 Sep 29 16:44:58 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3acf512c-d80e-45d2-9bca-9974e8a6e6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7c6b74f-0fff-4bc2-92f2-8a135a218d38', 'volume_name': 'volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38', 'volume_size': 1, 'image_id': '5abfcdb9-8bce-4722-8467-9621749b721a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abfcdb9-8bce-4722-8467-9621749b721a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--433306442', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91654f82510944ebb3b4d0b3088614e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abfcdb9-8bce-4722-8467-9621749b721a', 'created_at': datetime.datetime(2026, 9, 29, 14, 44, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 44, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abfcdb9-8bce-4722-8467-9621749b721a/file', 'properties': {}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e65a675-1a85-4b9e-8ad2-a63ed55a027e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e65a675-1a85-4b9e-8ad2-a63ed55a027e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d8cb9f-9322-4d7e-924c-cf485f799f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:58 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Volume f7c6b74f-0fff-4bc2-92f2-8a135a218d38: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38', 'volume_size': 1, 'image_id': '5abfcdb9-8bce-4722-8467-9621749b721a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abfcdb9-8bce-4722-8467-9621749b721a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--433306442', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91654f82510944ebb3b4d0b3088614e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abfcdb9-8bce-4722-8467-9621749b721a', 'created_at': datetime.datetime(2026, 9, 29, 14, 44, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 44, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abfcdb9-8bce-4722-8467-9621749b721a/file', 'properties': {}}, 'image_service': } Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Trying to clone f7c6b74f-0fff-4bc2-92f2-8a135a218d38 from image 5abfcdb9-8bce-4722-8467-9621749b721a at location (None, [{'url': 'file:///opt/stack/data/glance/images/5abfcdb9-8bce-4722-8467-9621749b721a', 'metadata': {}}]). {{(pid=86793) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 16:44:58 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6" returned: 0 in 0.253s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1871507045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6dbc44e-c386-4c0f-a5f5-f0cae0008437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c852fca1b54801b9f47e20ea5d7545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:58Z,use_quota=True,user_id='4192aecdd17c4f3caf3bedb75fee820b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Creating volume c6dbc44e-c386-4c0f-a5f5-f0cae0008437 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:44:58 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3bca1d6-9ac6-45f1-bae2-1a4ad56abaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:58 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437 1073741824 Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724fe5f6-14ae-47eb-be41-a7d6b3193966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:58 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:58 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Volume volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6 (7e5ce088-fccd-41af-b0e5-c92cf32d89e6): created successfully Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724fe5f6-14ae-47eb-be41-a7d6b3193966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Flow 'volume_create_manager' (958ef466-c864-4a0d-b84c-44c2ed6911f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:58 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e9aaecb3-c4e2-4a24-95a7-f7f771abb3c5 tempest-TestInstancesWithCinderVolumes-49409961 None] Created volume successfully. Sep 29 16:44:59 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437 1073741824" returned: 0 in 0.520s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:44:59 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437 Sep 29 16:44:59 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:44:59 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Sep 29 16:44:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437" returned: 0 in 0.262s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:44:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:44:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:44:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7f3bec8-954f-4fb2-90aa-dd060a67f8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e76cdac-b0e8-49f0-9b55-e814d48361d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:44:59 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Volume volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437 (c6dbc44e-c386-4c0f-a5f5-f0cae0008437): created successfully Sep 29 16:44:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e76cdac-b0e8-49f0-9b55-e814d48361d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:44:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Flow 'volume_create_manager' (e1a65601-fafd-4c0c-9b79-0fc1f46d5e6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:44:59 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5ecb0423-1028-4cee-b1c6-b5ea65f31a20 tempest-ProjectReaderTests-641602978 None] Created volume successfully. Sep 29 16:45:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Acquiring lock "cinder-c6dbc44e-c386-4c0f-a5f5-f0cae0008437-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:45:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Lock "cinder-c6dbc44e-c386-4c0f-a5f5-f0cae0008437-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:45:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Acquiring lock "cinder-quobyte-c6dbc44e-c386-4c0f-a5f5-f0cae0008437" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:45:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Lock "cinder-quobyte-c6dbc44e-c386-4c0f-a5f5-f0cae0008437" acquired by "delete_volume" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:45:00 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7251221c-9fd8-467f-b71b-5d28b112a1f4]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:45:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:00 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437 Sep 29 16:45:00 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:00 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437" returned: 0 in 0.407s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:00 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437 Sep 29 16:45:00 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:00 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c6dbc44e-c386-4c0f-a5f5-f0cae0008437" returned: 0 in 0.248s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Lock "cinder-quobyte-c6dbc44e-c386-4c0f-a5f5-f0cae0008437" released by "delete_volume" :: held 0.703s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Created reservations ['af8eaf74-5ff6-44cb-914e-09c2f3e78716', 'f6cc7786-64cb-4481-9e8a-1de34a98e274', '8050f4d3-dd0e-41ac-b9c3-4def5bfd950b', '15b9554e-1700-426e-a8e5-fddee0930104'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:01 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:45:01 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:01 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.276s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:45:01 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Deleted volume successfully. Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee32153b-70c5-4e17-ba35-9e8f8531811a tempest-ProjectReaderTests-641602978 None] Lock "cinder-c6dbc44e-c386-4c0f-a5f5-f0cae0008437-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Flow 'volume_create_manager' (c2f71d7f-e958-4b4a-8a1d-8bdc86065a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78fc76c4-c44c-4248-bbd0-48e941014772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78fc76c4-c44c-4248-bbd0-48e941014772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-795069446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d5715c-1700-4c4a-914c-bf1faa54123c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c852fca1b54801b9f47e20ea5d7545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:02Z,use_quota=True,user_id='4192aecdd17c4f3caf3bedb75fee820b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec6d414-f441-41cb-86b4-c5fc15d673c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec6d414-f441-41cb-86b4-c5fc15d673c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3771aebd-94a7-4d74-8ae4-8cca132f60e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3771aebd-94a7-4d74-8ae4-8cca132f60e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d5715c-1700-4c4a-914c-bf1faa54123c', 'volume_name': 'volume-10d5715c-1700-4c4a-914c-bf1faa54123c', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628ad630-22f5-413e-a601-c9ffc576deba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628ad630-22f5-413e-a601-c9ffc576deba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47636221-f959-4dbf-b78a-9a886c735aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:01 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Volume 10d5715c-1700-4c4a-914c-bf1faa54123c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d5715c-1700-4c4a-914c-bf1faa54123c', 'volume_size': 1} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-795069446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d5715c-1700-4c4a-914c-bf1faa54123c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c852fca1b54801b9f47e20ea5d7545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:02Z,use_quota=True,user_id='4192aecdd17c4f3caf3bedb75fee820b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Creating volume 10d5715c-1700-4c4a-914c-bf1faa54123c {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:45:01 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:45:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10d5715c-1700-4c4a-914c-bf1faa54123c 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:02 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10d5715c-1700-4c4a-914c-bf1faa54123c 1073741824 Sep 29 16:45:02 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5abfcdb9-8bce-4722-8467-9621749b721a_kgkoibs8devstack@QuobyteHD, size 20.69 MB, duration 3.70 sec {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 16:45:02 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Image download 20.69 MB at 5.59 MB/s Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cedc01-e9e1-418f-8d4a-64c9aaf17187]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abfcdb9-8bce-4722-8467-9621749b721a_kgkoibs8devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:02 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10d5715c-1700-4c4a-914c-bf1faa54123c 1073741824" returned: 0 in 0.527s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10d5715c-1700-4c4a-914c-bf1faa54123c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:02 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10d5715c-1700-4c4a-914c-bf1faa54123c Sep 29 16:45:02 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:02 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abfcdb9-8bce-4722-8467-9621749b721a_kgkoibs8devstack@QuobyteHD Sep 29 16:45:02 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:02 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10d5715c-1700-4c4a-914c-bf1faa54123c" returned: 0 in 0.291s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47636221-f959-4dbf-b78a-9a886c735aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d5715c-1700-4c4a-914c-bf1faa54123c', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3de069-fdf1-414c-a2a7-dcbafdc199ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:02 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abfcdb9-8bce-4722-8467-9621749b721a_kgkoibs8devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Temporary image 5abfcdb9-8bce-4722-8467-9621749b721a is fetched for user 1b7f3ced8a64415aad81001ead80ab6a. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 16:45:02 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Volume volume-10d5715c-1700-4c4a-914c-bf1faa54123c (10d5715c-1700-4c4a-914c-bf1faa54123c): created successfully Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3de069-fdf1-414c-a2a7-dcbafdc199ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Flow 'volume_create_manager' (c2f71d7f-e958-4b4a-8a1d-8bdc86065a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:45:02 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-99af6fb4-17f0-450c-be40-aed206824124 tempest-ProjectReaderTests-641602978 None] Created volume successfully. Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b97ffe-131a-44ee-8da3-df0f69b64ad7]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:45:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abfcdb9-8bce-4722-8467-9621749b721a_kgkoibs8devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:03 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abfcdb9-8bce-4722-8467-9621749b721a_kgkoibs8devstack@QuobyteHD Sep 29 16:45:03 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:03 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abfcdb9-8bce-4722-8467-9621749b721a_kgkoibs8devstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1779225007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c6b74f-0fff-4bc2-92f2-8a135a218d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91654f82510944ebb3b4d0b3088614e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:44:58Z,use_quota=True,user_id='1b7f3ced8a64415aad81001ead80ab6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15b943df-8be4-4ad7-bbeb-939c2352cdaf),volume_type_id=15b943df-8be4-4ad7-bbeb-939c2352cdaf)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:45:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Creating volume f7c6b74f-0fff-4bc2-92f2-8a135a218d38 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:45:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:45:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:45:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:45:03 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:45:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:03 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 1073741824 Sep 29 16:45:03 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:03 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 1073741824" returned: 0 in 0.455s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:03 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 Sep 29 16:45:03 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Acquiring lock "cinder-10d5715c-1700-4c4a-914c-bf1faa54123c-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Lock "cinder-10d5715c-1700-4c4a-914c-bf1faa54123c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Acquiring lock "cinder-quobyte-10d5715c-1700-4c4a-914c-bf1faa54123c" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:45:04 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38" returned: 0 in 0.324s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Lock "cinder-quobyte-10d5715c-1700-4c4a-914c-bf1faa54123c" acquired by "delete_volume" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Attempting download of 5abfcdb9-8bce-4722-8467-9621749b721a ((None, [{'url': 'file:///opt/stack/data/glance/images/5abfcdb9-8bce-4722-8467-9621749b721a', 'metadata': {}}])) to volume f7c6b74f-0fff-4bc2-92f2-8a135a218d38. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[69502e0c-7b54-4761-ae8b-ff2b79a4de84]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10d5715c-1700-4c4a-914c-bf1faa54123c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[111cd8d3-ea38-43d8-95d5-dcd2a9649b9b]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abfcdb9-8bce-4722-8467-9621749b721a_u4sp2wab {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:04 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10d5715c-1700-4c4a-914c-bf1faa54123c Sep 29 16:45:04 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:04 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abfcdb9-8bce-4722-8467-9621749b721a_u4sp2wab Sep 29 16:45:04 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:04 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10d5715c-1700-4c4a-914c-bf1faa54123c" returned: 0 in 0.431s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10d5715c-1700-4c4a-914c-bf1faa54123c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:04 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abfcdb9-8bce-4722-8467-9621749b721a_u4sp2wab" returned: 0 in 0.401s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abfcdb9-8bce-4722-8467-9621749b721a_u4sp2wab {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:04 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10d5715c-1700-4c4a-914c-bf1faa54123c Sep 29 16:45:04 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:04 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abfcdb9-8bce-4722-8467-9621749b721a_u4sp2wab Sep 29 16:45:04 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:04 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10d5715c-1700-4c4a-914c-bf1faa54123c" returned: 0 in 0.296s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Lock "cinder-quobyte-10d5715c-1700-4c4a-914c-bf1faa54123c" released by "delete_volume" :: held 0.788s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Created reservations ['6e93f4b6-3ab8-4ebb-997f-d32b33b6a2bd', '61616904-a9aa-4ba2-823e-045ed5e321ae', 'c828411f-beed-4e03-8e89-10e7a09f8bdc', 'bbed86d1-6c0a-4f2c-a012-feb56325338c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:05 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abfcdb9-8bce-4722-8467-9621749b721a_u4sp2wab" returned: 1 in 0.467s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abfcdb9-8bce-4722-8467-9621749b721a_u4sp2wab' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcde111-4f37-4f65-b19a-42ad306ee6fb]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abfcdb9-8bce-4722-8467-9621749b721a_kgkoibs8devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:05 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:45:05 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:05 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abfcdb9-8bce-4722-8467-9621749b721a_kgkoibs8devstack@QuobyteHD Sep 29 16:45:05 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:05 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.298s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:45:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Deleted volume successfully. Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-052849fb-20be-406b-ae7a-adcc31390c6e tempest-ProjectReaderTests-641602978 None] Lock "cinder-10d5715c-1700-4c4a-914c-bf1faa54123c-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:45:05 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abfcdb9-8bce-4722-8467-9621749b721a_kgkoibs8devstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] 5abfcdb9-8bce-4722-8467-9621749b721a was qcow2, converting to qcow2 {{(pid=86793) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 16:45:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abfcdb9-8bce-4722-8467-9621749b721a_kgkoibs8devstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:05 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abfcdb9-8bce-4722-8467-9621749b721a_kgkoibs8devstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 Sep 29 16:45:05 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Flow 'volume_create_manager' (e8cfc0dd-2a98-4b8b-a392-f8d0e10cebd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a870d45a-782c-4581-8408-c315990c2104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a870d45a-782c-4581-8408-c315990c2104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1542612717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e471c37f-12f1-4318-b9e9-d1b046297502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebbe29430ea54654ba408c096cfc5bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:07Z,use_quota=True,user_id='a4eaea26f4b54f3dab3dd57e31e7d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7744b5b-b18b-4fc5-838f-06178411aaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7744b5b-b18b-4fc5-838f-06178411aaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048b9e71-be69-4935-81f5-c5b55625ef47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048b9e71-be69-4935-81f5-c5b55625ef47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e471c37f-12f1-4318-b9e9-d1b046297502', 'volume_name': 'volume-e471c37f-12f1-4318-b9e9-d1b046297502', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44bdc37f-11a9-4090-ad5c-a4098351331a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44bdc37f-11a9-4090-ad5c-a4098351331a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea7b6ba-56eb-4e2c-aac6-9c85dfe44ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:07 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Volume e471c37f-12f1-4318-b9e9-d1b046297502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e471c37f-12f1-4318-b9e9-d1b046297502', 'volume_size': 1} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1542612717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e471c37f-12f1-4318-b9e9-d1b046297502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebbe29430ea54654ba408c096cfc5bcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:07Z,use_quota=True,user_id='a4eaea26f4b54f3dab3dd57e31e7d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Creating volume e471c37f-12f1-4318-b9e9-d1b046297502 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:45:07 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e471c37f-12f1-4318-b9e9-d1b046297502 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:07 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e471c37f-12f1-4318-b9e9-d1b046297502 1073741824 Sep 29 16:45:07 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:07 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abfcdb9-8bce-4722-8467-9621749b721a_kgkoibs8devstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38" returned: 0 in 2.342s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5abfcdb9-8bce-4722-8467-9621749b721a_kgkoibs8devstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:45:07 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Converted 112.00 MB image at 47.78 MB/s Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:07 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 1G Sep 29 16:45:07 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:07 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e471c37f-12f1-4318-b9e9-d1b046297502 1073741824" returned: 0 in 0.566s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e471c37f-12f1-4318-b9e9-d1b046297502 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:07 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e471c37f-12f1-4318-b9e9-d1b046297502 Sep 29 16:45:07 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:08 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:08 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 1G" returned: 0 in 0.361s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Downloaded image 5abfcdb9-8bce-4722-8467-9621749b721a ((None, [{'url': 'file:///opt/stack/data/glance/images/5abfcdb9-8bce-4722-8467-9621749b721a', 'metadata': {}}])) to volume f7c6b74f-0fff-4bc2-92f2-8a135a218d38 successfully. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Temporary image 5abfcdb9-8bce-4722-8467-9621749b721a for user 1b7f3ced8a64415aad81001ead80ab6a is deleted. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Marking volume f7c6b74f-0fff-4bc2-92f2-8a135a218d38 as bootable. {{(pid=86793) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e471c37f-12f1-4318-b9e9-d1b046297502" returned: 0 in 0.310s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea7b6ba-56eb-4e2c-aac6-9c85dfe44ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e471c37f-12f1-4318-b9e9-d1b046297502', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e95fe45-cdb4-4d6f-9275-858322943fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Copying metadata from image 5abfcdb9-8bce-4722-8467-9621749b721a to f7c6b74f-0fff-4bc2-92f2-8a135a218d38. {{(pid=86793) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Creating volume glance metadata for volume f7c6b74f-0fff-4bc2-92f2-8a135a218d38 backed by image 5abfcdb9-8bce-4722-8467-9621749b721a with: {'image_id': '5abfcdb9-8bce-4722-8467-9621749b721a', 'image_name': 'tempest-scenario-img--433306442', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86793) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 16:45:08 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Volume volume-e471c37f-12f1-4318-b9e9-d1b046297502 (e471c37f-12f1-4318-b9e9-d1b046297502): created successfully Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e95fe45-cdb4-4d6f-9275-858322943fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Flow 'volume_create_manager' (e8cfc0dd-2a98-4b8b-a392-f8d0e10cebd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:45:08 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-639a6f9d-d17c-40e9-9845-2fef530599f3 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Created volume successfully. Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d8cb9f-9322-4d7e-924c-cf485f799f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38', 'volume_size': 1, 'image_id': '5abfcdb9-8bce-4722-8467-9621749b721a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abfcdb9-8bce-4722-8467-9621749b721a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--433306442', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '91654f82510944ebb3b4d0b3088614e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abfcdb9-8bce-4722-8467-9621749b721a', 'created_at': datetime.datetime(2026, 9, 29, 14, 44, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 44, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abfcdb9-8bce-4722-8467-9621749b721a/file', 'properties': {}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441ec8a5-a8ac-40b9-aaea-450979e8e37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:08 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Volume volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 (f7c6b74f-0fff-4bc2-92f2-8a135a218d38): created successfully Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441ec8a5-a8ac-40b9-aaea-450979e8e37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Flow 'volume_create_manager' (88ba81c6-cd36-4a3b-bc9f-39aaae773096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:45:08 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-315881ac-e4b8-4294-851c-3df6ba8f7167 tempest-TestInstancesWithCinderVolumes-49409961 None] Created volume successfully. Sep 29 16:45:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-9cda8672-e038-4fb5-9a0e-904e03196560 req-9f0c3b8a-c671-4bba-a41a-cf95f5287025 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-9cda8672-e038-4fb5-9a0e-904e03196560 req-9f0c3b8a-c671-4bba-a41a-cf95f5287025 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-9cda8672-e038-4fb5-9a0e-904e03196560 req-9f0c3b8a-c671-4bba-a41a-cf95f5287025 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:10 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-9cda8672-e038-4fb5-9a0e-904e03196560 req-9f0c3b8a-c671-4bba-a41a-cf95f5287025 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-e471c37f-12f1-4318-b9e9-d1b046297502', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b86ca04c-359c-4047-bc70-d4cc88b0a6fd', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:45:10 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-9cda8672-e038-4fb5-9a0e-904e03196560 req-9f0c3b8a-c671-4bba-a41a-cf95f5287025 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] attachment_update completed successfully. Sep 29 16:45:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-6d91880f-8e59-458f-93cb-9f121d21345a req-1bab54ec-74a3-41ac-af00-0c81f1253443 tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-6d91880f-8e59-458f-93cb-9f121d21345a req-1bab54ec-74a3-41ac-af00-0c81f1253443 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-6d91880f-8e59-458f-93cb-9f121d21345a req-1bab54ec-74a3-41ac-af00-0c81f1253443 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-6d91880f-8e59-458f-93cb-9f121d21345a req-1bab54ec-74a3-41ac-af00-0c81f1253443 tempest-TestInstancesWithCinderVolumes-49409961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca5e3e8a-af91-468c-b50d-ecc5caa81949', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:45:12 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-6d91880f-8e59-458f-93cb-9f121d21345a req-1bab54ec-74a3-41ac-af00-0c81f1253443 tempest-TestInstancesWithCinderVolumes-49409961 None] attachment_update completed successfully. Sep 29 16:45:14 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-af7ed159-a2e7-4519-a1c7-da69aadb4d5e req-30b269bf-edb1-4b4d-bd58-41df1d05f416 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Terminate volume connection completed successfully. Sep 29 16:45:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-af7ed159-a2e7-4519-a1c7-da69aadb4d5e req-30b269bf-edb1-4b4d-bd58-41df1d05f416 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Deleting attachment b86ca04c-359c-4047-bc70-d4cc88b0a6fd. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:45:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Acquiring lock "cinder-e471c37f-12f1-4318-b9e9-d1b046297502-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:45:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Lock "cinder-e471c37f-12f1-4318-b9e9-d1b046297502-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:45:14 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=123,cinder:UPDATE=157,cinder:INSERT=44,cinder:DELETE=18 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:45:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Acquiring lock "cinder-quobyte-e471c37f-12f1-4318-b9e9-d1b046297502" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:45:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Lock "cinder-quobyte-e471c37f-12f1-4318-b9e9-d1b046297502" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:45:15 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0614d843-21ef-4cd3-b697-9be3dd24dd9a]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:45:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e471c37f-12f1-4318-b9e9-d1b046297502 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:15 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e471c37f-12f1-4318-b9e9-d1b046297502 Sep 29 16:45:15 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:15 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e471c37f-12f1-4318-b9e9-d1b046297502" returned: 0 in 0.618s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e471c37f-12f1-4318-b9e9-d1b046297502 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:15 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e471c37f-12f1-4318-b9e9-d1b046297502 Sep 29 16:45:15 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:16 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e471c37f-12f1-4318-b9e9-d1b046297502" returned: 0 in 0.361s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Lock "cinder-quobyte-e471c37f-12f1-4318-b9e9-d1b046297502" released by "delete_volume" :: held 1.130s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:45:16 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Created reservations ['a9baa31c-5434-447e-a0ba-c3de1172effb', '4b79056e-4665-49d2-8904-2eb6ccf058f2', 'b4749c4c-12a8-4183-9525-f8d4f595895e', '1165cbee-7dfa-4edd-8285-2178d66a0ef2'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:45:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:45:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:45:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:16 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:45:16 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:16 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.279s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:16 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:45:16 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Deleted volume successfully. Sep 29 16:45:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0ccc05c4-58ae-4ff2-abb7-64ad4cc173d5 tempest-TestServerVolumeAttachScenarioOldVersion-1307872585 None] Lock "cinder-e471c37f-12f1-4318-b9e9-d1b046297502-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:45:26 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:45:26 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=94,cinder:SELECT=63,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:45:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:45:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:45:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:45:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:34 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:45:34 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:35 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.270s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:45:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:45:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:45:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:45:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-aad4dad1-4316-4084-9f2f-f622b5621a7e req-119de06a-e91a-4386-90cf-6fe6fbb85478 tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-aad4dad1-4316-4084-9f2f-f622b5621a7e req-119de06a-e91a-4386-90cf-6fe6fbb85478 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-aad4dad1-4316-4084-9f2f-f622b5621a7e req-119de06a-e91a-4386-90cf-6fe6fbb85478 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:47 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-aad4dad1-4316-4084-9f2f-f622b5621a7e req-119de06a-e91a-4386-90cf-6fe6fbb85478 tempest-TestInstancesWithCinderVolumes-49409961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe53e639-00dc-411a-8145-4d4096144746', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:45:47 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-aad4dad1-4316-4084-9f2f-f622b5621a7e req-119de06a-e91a-4386-90cf-6fe6fbb85478 tempest-TestInstancesWithCinderVolumes-49409961 None] attachment_update completed successfully. Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-16be240d-3e6e-45f8-b428-8bf9cfc93757 req-ff4e5a47-e5fc-49f3-ba3f-022037331edf tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-16be240d-3e6e-45f8-b428-8bf9cfc93757 req-ff4e5a47-e5fc-49f3-ba3f-022037331edf tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-16be240d-3e6e-45f8-b428-8bf9cfc93757 req-ff4e5a47-e5fc-49f3-ba3f-022037331edf tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-16be240d-3e6e-45f8-b428-8bf9cfc93757 req-ff4e5a47-e5fc-49f3-ba3f-022037331edf tempest-TestInstancesWithCinderVolumes-49409961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '055b67dc-02cb-46a0-9194-91c5949e2d6e', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:45:50 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-16be240d-3e6e-45f8-b428-8bf9cfc93757 req-ff4e5a47-e5fc-49f3-ba3f-022037331edf tempest-TestInstancesWithCinderVolumes-49409961 None] attachment_update completed successfully. Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Flow 'volume_create_manager' (7809148d-2952-45fb-8914-35a10aa4e847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19039cf-3353-41a8-9da2-f5b9d5515e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19039cf-3353-41a8-9da2-f5b9d5515e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2089170434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd57aa0b-0ce3-49a1-a340-a8239952e0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ee27994e0644a1b1a1389e6d5ee3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:51Z,use_quota=True,user_id='3e978bee820c430bb2a0968a471afda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ef32c7-f968-4812-9475-64db60487b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ef32c7-f968-4812-9475-64db60487b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (732a6014-074b-49ef-9d1a-ff165b170e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (732a6014-074b-49ef-9d1a-ff165b170e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd57aa0b-0ce3-49a1-a340-a8239952e0c3', 'volume_name': 'volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0bd2af-74bd-45b8-a262-289c0878ea35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0bd2af-74bd-45b8-a262-289c0878ea35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87186417-7c14-408e-b807-f6841479b866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:50 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Volume bd57aa0b-0ce3-49a1-a340-a8239952e0c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3', 'volume_size': 1} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2089170434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd57aa0b-0ce3-49a1-a340-a8239952e0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ee27994e0644a1b1a1389e6d5ee3a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:45:51Z,use_quota=True,user_id='3e978bee820c430bb2a0968a471afda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Creating volume bd57aa0b-0ce3-49a1-a340-a8239952e0c3 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:45:50 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:45:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:50 devstack sudo[103685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 1073741824 Sep 29 16:45:50 devstack sudo[103685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:51 devstack sudo[103685]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 1073741824" returned: 0 in 0.512s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:51 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 Sep 29 16:45:51 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:51 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3" returned: 0 in 0.272s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:45:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:45:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87186417-7c14-408e-b807-f6841479b866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2f421b-ebe8-4166-abad-0928f5d0eff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:45:51 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Volume volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 (bd57aa0b-0ce3-49a1-a340-a8239952e0c3): created successfully Sep 29 16:45:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2f421b-ebe8-4166-abad-0928f5d0eff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:45:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Flow 'volume_create_manager' (7809148d-2952-45fb-8914-35a10aa4e847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:45:51 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-9e8fe51d-8715-41c0-a159-9f5c98edadf9 tempest-TestImageHashVerification-1506777672 None] Created volume successfully. Sep 29 16:45:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:45:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:45:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d7cdd0-7e59-411e-8fe5-e02df9a21168]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:45:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:53 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 Sep 29 16:45:53 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:54 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3" returned: 0 in 0.382s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:54 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0686394a-552e-43be-bba6-89ab457729ac]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:45:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:54 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 Sep 29 16:45:54 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:54 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3" returned: 0 in 0.374s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 /opt/stack/data/cinder/conversion/bd57aa0b-0ce3-49a1-a340-a8239952e0c3.temp_image.1f8a72eb-d48d-4bfb-b814-826c2c7591f8u5jg8_wa.img {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:54 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 /opt/stack/data/cinder/conversion/bd57aa0b-0ce3-49a1-a340-a8239952e0c3.temp_image.1f8a72eb-d48d-4bfb-b814-826c2c7591f8u5jg8_wa.img Sep 29 16:45:54 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-f056ed16-31a3-48ca-b09b-9aa2fc0eb65a req-e3f87d46-5846-46a4-9edc-0a82048dde5f tempest-TestInstancesWithCinderVolumes-49409961 None] Terminate volume connection completed successfully. Sep 29 16:45:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-f056ed16-31a3-48ca-b09b-9aa2fc0eb65a req-e3f87d46-5846-46a4-9edc-0a82048dde5f tempest-TestInstancesWithCinderVolumes-49409961 None] Deleting attachment fe53e639-00dc-411a-8145-4d4096144746. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:45:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "cinder-6feeaccc-77eb-443c-b29a-c2cfc03e4742-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:45:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "cinder-6feeaccc-77eb-443c-b29a-c2cfc03e4742-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:45:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "cinder-quobyte-6feeaccc-77eb-443c-b29a-c2cfc03e4742" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:45:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "cinder-quobyte-6feeaccc-77eb-443c-b29a-c2cfc03e4742" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:45:58 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5286b6-9b03-4dab-9166-58bae8919ce9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:45:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:59 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742 Sep 29 16:45:59 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:59 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742" returned: 0 in 0.624s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:45:59 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742 Sep 29 16:45:59 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:45:59 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Sep 29 16:45:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6feeaccc-77eb-443c-b29a-c2cfc03e4742" returned: 0 in 0.409s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:45:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "cinder-quobyte-6feeaccc-77eb-443c-b29a-c2cfc03e4742" released by "delete_volume" :: held 1.117s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:45:59 devstack cinder-volume[86793]: WARNING cinder.quota [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1561062545-1127359720 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1561062545-1127359720, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:45:59 devstack cinder-volume[86793]: WARNING cinder.quota [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1561062545-1127359720 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1561062545-1127359720, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:46:00 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Created reservations ['1a0aae9c-5578-4320-82f1-104a70dd9379', 'b35ac476-e72e-4971-ba46-22e5fd63fb67', 'fde81c01-0c4d-46c0-b5b1-350edaf93a8c', '9f8cabb5-a5b8-4569-9c94-ef9bda134302'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:46:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:46:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:46:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:46:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:46:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:46:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:00 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:46:00 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:00 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.536s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:00 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:46:00 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Deleted volume successfully. Sep 29 16:46:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fab1fe51-358f-4692-b761-c8b4c10bc267 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "cinder-6feeaccc-77eb-443c-b29a-c2cfc03e4742-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:01 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 /opt/stack/data/cinder/conversion/bd57aa0b-0ce3-49a1-a340-a8239952e0c3.temp_image.1f8a72eb-d48d-4bfb-b814-826c2c7591f8u5jg8_wa.img" returned: 0 in 6.915s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:01 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae8b069-d1e8-46e0-b9fc-d90bdac7b860]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:46:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:01 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 Sep 29 16:46:01 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:01 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3" returned: 0 in 0.536s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:01 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3, size 1024.00 MB, duration 6.92 sec, destination /opt/stack/data/cinder/conversion/bd57aa0b-0ce3-49a1-a340-a8239952e0c3.temp_image.1f8a72eb-d48d-4bfb-b814-826c2c7591f8u5jg8_wa.img {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:46:01 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] Converted 1024.00 MB image at 148.05 MB/s Sep 29 16:46:01 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] 1f8a72eb-d48d-4bfb-b814-826c2c7591f8 was raw, no need to convert to raw {{(pid=86793) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 29 16:46:03 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-aebd7322-d2af-429e-aa7f-b7a721919301 req-37532f7f-014a-40ea-98cf-dcc766b5d6b0 tempest-TestInstancesWithCinderVolumes-49409961 None] Terminate volume connection completed successfully. Sep 29 16:46:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-aebd7322-d2af-429e-aa7f-b7a721919301 req-37532f7f-014a-40ea-98cf-dcc766b5d6b0 tempest-TestInstancesWithCinderVolumes-49409961 None] Deleting attachment 055b67dc-02cb-46a0-9194-91c5949e2d6e. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:46:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "cinder-7e5ce088-fccd-41af-b0e5-c92cf32d89e6-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "cinder-7e5ce088-fccd-41af-b0e5-c92cf32d89e6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "cinder-quobyte-7e5ce088-fccd-41af-b0e5-c92cf32d89e6" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "cinder-quobyte-7e5ce088-fccd-41af-b0e5-c92cf32d89e6" acquired by "delete_volume" :: waited 0.027s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cc588c-21f3-461c-9bb9-986c1d32d460]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:46:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:04 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6 Sep 29 16:46:04 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:04 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6" returned: 0 in 0.426s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:04 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6 Sep 29 16:46:04 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:04 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7e5ce088-fccd-41af-b0e5-c92cf32d89e6" returned: 0 in 0.294s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "cinder-quobyte-7e5ce088-fccd-41af-b0e5-c92cf32d89e6" released by "delete_volume" :: held 0.812s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:04 devstack cinder-volume[86793]: WARNING cinder.quota [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-976782220-156873990 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-976782220-156873990, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:46:04 devstack cinder-volume[86793]: WARNING cinder.quota [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-976782220-156873990 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-976782220-156873990, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:46:04 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Created reservations ['8ba4dd6d-0541-4592-8847-e24b427856b5', 'c322e713-8625-47f9-a284-1fa34aaf600b', '9da5cdad-f57b-4841-aa08-4c2be41065cb', '18534529-f63e-4ee9-913b-6b8ce94d166d'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:46:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:46:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:46:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:46:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:46:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:46:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:05 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:46:05 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:05 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.362s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:05 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:46:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Deleted volume successfully. Sep 29 16:46:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-49a2cb0e-230b-4819-9d6f-e96899f676af tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "cinder-7e5ce088-fccd-41af-b0e5-c92cf32d89e6-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:09 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-38fce28a-a656-4a8b-b92f-fec8a54011f8 req-ae77454e-ad06-4f5f-8f46-270f3facb095 tempest-TestInstancesWithCinderVolumes-49409961 None] Terminate volume connection completed successfully. Sep 29 16:46:09 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-38fce28a-a656-4a8b-b92f-fec8a54011f8 req-ae77454e-ad06-4f5f-8f46-270f3facb095 tempest-TestInstancesWithCinderVolumes-49409961 None] Deleting attachment ca5e3e8a-af91-468c-b50d-ecc5caa81949. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:46:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "cinder-f7c6b74f-0fff-4bc2-92f2-8a135a218d38-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "cinder-f7c6b74f-0fff-4bc2-92f2-8a135a218d38-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "cinder-quobyte-f7c6b74f-0fff-4bc2-92f2-8a135a218d38" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "cinder-quobyte-f7c6b74f-0fff-4bc2-92f2-8a135a218d38" acquired by "delete_volume" :: waited 0.021s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2dccbe-fed1-4cd7-b907-e060f777f3d7]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:11 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 Sep 29 16:46:11 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:11 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38" returned: 0 in 0.390s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:11 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38 Sep 29 16:46:11 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:11 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7c6b74f-0fff-4bc2-92f2-8a135a218d38" returned: 0 in 0.262s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "cinder-quobyte-f7c6b74f-0fff-4bc2-92f2-8a135a218d38" released by "delete_volume" :: held 0.699s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:11 devstack cinder-volume[86793]: WARNING cinder.quota [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2114520625-989766745 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2114520625-989766745, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:46:11 devstack cinder-volume[86793]: WARNING cinder.quota [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2114520625-989766745 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2114520625-989766745, it is now deprecated. Please use the default quota class for default quota. Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Created reservations ['0b4d80be-fc9f-4d44-aaab-5bfeda692099', 'cac99dda-dafa-4152-b755-e29afca3bb28', 'f04c485e-bde4-494e-ba0d-e05c504b69ba', 'cf6cf8ae-87e6-47a6-870c-66040199b5ee'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:46:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:11 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:46:11 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:12 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.261s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:12 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:46:12 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Deleted volume successfully. Sep 29 16:46:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-46a0620a-0968-4f22-bfe9-4656cffba5d8 tempest-TestInstancesWithCinderVolumes-49409961 None] Lock "cinder-f7c6b74f-0fff-4bc2-92f2-8a135a218d38-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:22 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=36,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:46:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.418s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:46:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] Uploaded volume to glance image-id: 1f8a72eb-d48d-4bfb-b814-826c2c7591f8. {{(pid=86793) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 29 16:46:23 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-63ef3317-691b-43a1-8643-8b0431e08900 tempest-TestImageHashVerification-1506777672 None] Copy volume to image completed successfully. Sep 29 16:46:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Acquiring lock "cinder-bd57aa0b-0ce3-49a1-a340-a8239952e0c3-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Lock "cinder-bd57aa0b-0ce3-49a1-a340-a8239952e0c3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Acquiring lock "cinder-quobyte-bd57aa0b-0ce3-49a1-a340-a8239952e0c3" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Lock "cinder-quobyte-bd57aa0b-0ce3-49a1-a340-a8239952e0c3" acquired by "delete_volume" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:24 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c60ef9-80e6-4ac1-aabb-51d117b55d69]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:46:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:24 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 Sep 29 16:46:24 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:24 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3" returned: 0 in 0.367s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:24 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3 Sep 29 16:46:24 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:25 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bd57aa0b-0ce3-49a1-a340-a8239952e0c3" returned: 0 in 0.243s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Lock "cinder-quobyte-bd57aa0b-0ce3-49a1-a340-a8239952e0c3" released by "delete_volume" :: held 0.659s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:25 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Created reservations ['4820b866-1175-400d-b8da-e8c24a25215e', '406326be-953d-4359-9c8d-f0e607ade918', '83a9c7a9-269c-4bbb-b282-1fbea2f80ca4', 'b6b3289c-c171-4027-9f67-d8db58b724e6'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:46:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:46:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:46:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:46:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:46:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:46:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:25 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:46:25 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:25 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.264s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:25 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:46:25 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Deleted volume successfully. Sep 29 16:46:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7fb0999c-f693-4523-be07-f8a70dcfc42f tempest-TestImageHashVerification-1506777672 None] Lock "cinder-bd57aa0b-0ce3-49a1-a340-a8239952e0c3-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:46:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:46:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:46:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:46:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:46:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:46:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:34 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:46:34 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:35 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.302s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:46:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:46:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:46:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:46:35 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=39,cinder:UPDATE=37,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:46:35 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Flow 'volume_create_manager' (b2ff2d8f-c15c-48c4-b04f-39bb1ce2506f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762093ac-1087-4a29-bcb6-052dc89b4d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762093ac-1087-4a29-bcb6-052dc89b4d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-976908767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e370cb89-8577-4960-8022-7ebea5ba0edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69136a529a5a4e96a683690d667f4496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:46:39Z,use_quota=True,user_id='0d0f66364efd4e20bd6cf8154e929568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5a90be-9dc3-4c3c-8743-cb49f4b02078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5a90be-9dc3-4c3c-8743-cb49f4b02078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e81e19-97cf-4138-a51d-2656b5c7bcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e81e19-97cf-4138-a51d-2656b5c7bcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e370cb89-8577-4960-8022-7ebea5ba0edd', 'volume_name': 'volume-e370cb89-8577-4960-8022-7ebea5ba0edd', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134a9a23-a29d-4de9-853a-719feb2fe7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134a9a23-a29d-4de9-853a-719feb2fe7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037c24f0-24a2-4bba-b498-79247ed20615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:46:39 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Volume e370cb89-8577-4960-8022-7ebea5ba0edd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e370cb89-8577-4960-8022-7ebea5ba0edd', 'volume_size': 1} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:46:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-976908767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e370cb89-8577-4960-8022-7ebea5ba0edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69136a529a5a4e96a683690d667f4496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:46:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:46:39Z,use_quota=True,user_id='0d0f66364efd4e20bd6cf8154e929568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Creating volume e370cb89-8577-4960-8022-7ebea5ba0edd {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:46:39 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:39 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd 1073741824 Sep 29 16:46:39 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:39 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd 1073741824" returned: 0 in 0.472s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:40 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd Sep 29 16:46:40 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:40 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd" returned: 0 in 0.242s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:40 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:46:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:46:40 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037c24f0-24a2-4bba-b498-79247ed20615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e370cb89-8577-4960-8022-7ebea5ba0edd', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:46:40 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60161961-8707-402f-a456-6244c7dc2780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:46:40 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Volume volume-e370cb89-8577-4960-8022-7ebea5ba0edd (e370cb89-8577-4960-8022-7ebea5ba0edd): created successfully Sep 29 16:46:40 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60161961-8707-402f-a456-6244c7dc2780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:46:40 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Flow 'volume_create_manager' (b2ff2d8f-c15c-48c4-b04f-39bb1ce2506f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:46:40 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-110aba02-7c29-4138-9c06-68be9bdddc00 tempest-VolumeDependencyTests-929586349 None] Created volume successfully. Sep 29 16:46:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:46:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:46:40 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] Creating offline snapshot 4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 of volume e370cb89-8577-4960-8022-7ebea5ba0edd {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:46:40 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ff6078-09f4-4033-989c-8680fe312570]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:46:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:40 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd Sep 29 16:46:40 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:41 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd" returned: 0 in 0.395s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:41 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 1G Sep 29 16:46:41 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:41 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 1G" returned: 0 in 0.414s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e370cb89-8577-4960-8022-7ebea5ba0edd -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:41 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e370cb89-8577-4960-8022-7ebea5ba0edd -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 Sep 29 16:46:41 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:41 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e370cb89-8577-4960-8022-7ebea5ba0edd -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09" returned: 0 in 0.400s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:41 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 is being set with open permissions: ugo+rw Sep 29 16:46:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:41 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 Sep 29 16:46:41 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:42 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09" returned: 0 in 0.297s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:42 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.info Sep 29 16:46:42 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:42 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.info" returned: 0 in 0.251s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:42 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.info is being set with open permissions: ugo+rw Sep 29 16:46:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:42 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.info Sep 29 16:46:42 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:42 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.info" returned: 0 in 0.262s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.138s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:46:42 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a20ace99-cfac-4dfb-a1ed-a64d056d89b8 tempest-VolumeDependencyTests-929586349 None] Create snapshot completed successfully Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Flow 'volume_create_manager' (9a312d95-25b6-4409-9c3d-97dae49d41a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ec7546-30a1-4de9-8918-c0b4ea186259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ec7546-30a1-4de9-8918-c0b4ea186259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2088901867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5585c87-7676-45bb-8ac3-18fe0f24f49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69136a529a5a4e96a683690d667f4496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4f7d45f7-e21b-41ae-ba12-d8cf3080fb09,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:46:44Z,use_quota=True,user_id='0d0f66364efd4e20bd6cf8154e929568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26fef0b9-dddd-4533-a777-12d7facccfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26fef0b9-dddd-4533-a777-12d7facccfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319f61cf-094f-4448-b1be-64e000909f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319f61cf-094f-4448-b1be-64e000909f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e5585c87-7676-45bb-8ac3-18fe0f24f49b', 'volume_name': 'volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b', 'volume_size': 1, 'snapshot_id': '4f7d45f7-e21b-41ae-ba12-d8cf3080fb09'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b43afa-2f01-4610-98c3-a6b618180904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b43afa-2f01-4610-98c3-a6b618180904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d69c3c-542f-406f-9568-9d1598dcc2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:46:44 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Volume e5585c87-7676-45bb-8ac3-18fe0f24f49b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b', 'volume_size': 1, 'snapshot_id': '4f7d45f7-e21b-41ae-ba12-d8cf3080fb09'} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Acquiring lock "cinder-quobyte-4f7d45f7-e21b-41ae-ba12-d8cf3080fb09-e5585c87-7676-45bb-8ac3-18fe0f24f49b" by "_create_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Lock "cinder-quobyte-4f7d45f7-e21b-41ae-ba12-d8cf3080fb09-e5585c87-7676-45bb-8ac3-18fe0f24f49b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Creating volume e5585c87-7676-45bb-8ac3-18fe0f24f49b from snapshot 4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 {{(pid=86793) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Acquiring lock "cinder-quobyte-e5585c87-7676-45bb-8ac3-18fe0f24f49b" by "_copy_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Lock "cinder-quobyte-e5585c87-7676-45bb-8ac3-18fe0f24f49b" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] snapshot: 4f7d45f7-e21b-41ae-ba12-d8cf3080fb09, volume: e5585c87-7676-45bb-8ac3-18fe0f24f49b, {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2ded02-6ca5-473a-8683-6a97038d2ad6]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:44 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 Sep 29 16:46:44 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:44 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09" returned: 0 in 0.411s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e370cb89-8577-4960-8022-7ebea5ba0edd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f621766-3893-44d3-8b47-20d337f783d2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:46:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:45 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd Sep 29 16:46:45 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:45 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd" returned: 0 in 0.375s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] will copy from snapshot at /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 16:46:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Creating direct copy from snapshot {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 16:46:45 devstack cinder-volume[86793]: DEBUG cinder.utils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Path /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b not found in is_blk_device check {{(pid=86793) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 16:46:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:45 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b Sep 29 16:46:45 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:52 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b" returned: 0 in 6.868s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:52 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd, size 1024.00 MB, duration 6.87 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:46:52 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Converted 1024.00 MB image at 149.07 MB/s Sep 29 16:46:52 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b is being set with open permissions: ugo+rw Sep 29 16:46:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:52 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b Sep 29 16:46:52 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:52 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b" returned: 0 in 0.242s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Lock "cinder-quobyte-e5585c87-7676-45bb-8ac3-18fe0f24f49b" released by "_copy_volume_from_snapshot" :: held 7.995s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Lock "cinder-quobyte-4f7d45f7-e21b-41ae-ba12-d8cf3080fb09-e5585c87-7676-45bb-8ac3-18fe0f24f49b" released by "_create_volume_from_snapshot" :: held 8.077s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.092s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:46:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50d69c3c-542f-406f-9568-9d1598dcc2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b', 'volume_size': 1, 'snapshot_id': '4f7d45f7-e21b-41ae-ba12-d8cf3080fb09'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:46:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada898d8-a878-4b3a-98ff-1e939f2f6bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:46:52 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Volume volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b (e5585c87-7676-45bb-8ac3-18fe0f24f49b): created successfully Sep 29 16:46:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada898d8-a878-4b3a-98ff-1e939f2f6bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:46:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Flow 'volume_create_manager' (9a312d95-25b6-4409-9c3d-97dae49d41a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:46:52 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-dfb9c62e-3119-43fd-b865-041184899183 tempest-VolumeDependencyTests-929586349 None] Created volume successfully. Sep 29 16:46:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Acquiring lock "cinder-4f7d45f7-e21b-41ae-ba12-d8cf3080fb09-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Lock "cinder-4f7d45f7-e21b-41ae-ba12-d8cf3080fb09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Acquiring lock "cinder-quobyte-e370cb89-8577-4960-8022-7ebea5ba0edd" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Lock "cinder-quobyte-e370cb89-8577-4960-8022-7ebea5ba0edd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Acquiring lock "cinder-quobyte-4f7d45f7-e21b-41ae-ba12-d8cf3080fb09" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Lock "cinder-quobyte-4f7d45f7-e21b-41ae-ba12-d8cf3080fb09" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Deleting offline snapshot 4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 of volume e370cb89-8577-4960-8022-7ebea5ba0edd {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:46:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] snapshot_file for this snap is: volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:46:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f891d427-0fe6-42cd-b55e-65cca798e2c5]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:46:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:53 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 Sep 29 16:46:53 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:53 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09" returned: 0 in 0.383s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e370cb89-8577-4960-8022-7ebea5ba0edd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:46:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4974fc3-2ccb-4bcd-9920-7c375f54ebef]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:46:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:53 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd Sep 29 16:46:53 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:54 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd" returned: 0 in 0.540s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:54 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 Sep 29 16:46:54 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:54 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09" returned: 0 in 0.360s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:54 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09 Sep 29 16:46:54 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:54 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd.4f7d45f7-e21b-41ae-ba12-d8cf3080fb09" returned: 0 in 0.296s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Lock "cinder-quobyte-4f7d45f7-e21b-41ae-ba12-d8cf3080fb09" released by "_delete_snapshot" :: held 1.714s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Lock "cinder-quobyte-e370cb89-8577-4960-8022-7ebea5ba0edd" released by "delete_snapshot" :: held 1.736s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:55 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Created reservations ['9776205e-edc6-4d8b-8dd6-55acfe1a7640', '2da22ba6-bd20-410f-985c-f15e0a12c41e', 'f975d108-81a8-4b29-bc6e-1e8d7dac5a33', 'd030eb86-1ffe-4a23-9fb3-b587ab649338'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:46:55 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Delete snapshot completed successfully. Sep 29 16:46:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-77cfb37f-3d61-4fcf-82d6-319a9442751a tempest-VolumeDependencyTests-929586349 None] Lock "cinder-4f7d45f7-e21b-41ae-ba12-d8cf3080fb09-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Acquiring lock "cinder-e370cb89-8577-4960-8022-7ebea5ba0edd-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Lock "cinder-e370cb89-8577-4960-8022-7ebea5ba0edd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Acquiring lock "cinder-quobyte-e370cb89-8577-4960-8022-7ebea5ba0edd" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Lock "cinder-quobyte-e370cb89-8577-4960-8022-7ebea5ba0edd" acquired by "delete_volume" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:55 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b7223c-6ad7-40b4-bbf3-0a849670cfcc]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:46:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:55 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd Sep 29 16:46:55 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:56 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd" returned: 0 in 0.521s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:56 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd Sep 29 16:46:56 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:56 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e370cb89-8577-4960-8022-7ebea5ba0edd" returned: 0 in 0.269s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Lock "cinder-quobyte-e370cb89-8577-4960-8022-7ebea5ba0edd" released by "delete_volume" :: held 0.915s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Created reservations ['f2893337-6d73-4586-a9db-775229209cb8', 'c0e4a162-3fec-4fc9-bc30-4d3039cf2f5d', 'deb577bd-1930-4aa7-aa83-e02770417edc', 'b317b93e-2c00-4fc8-92be-c3b2a6367e72'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Acquiring lock "cinder-e5585c87-7676-45bb-8ac3-18fe0f24f49b-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:56 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:46:56 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Lock "cinder-e5585c87-7676-45bb-8ac3-18fe0f24f49b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Acquiring lock "cinder-quobyte-e5585c87-7676-45bb-8ac3-18fe0f24f49b" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Lock "cinder-quobyte-e5585c87-7676-45bb-8ac3-18fe0f24f49b" acquired by "delete_volume" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50e8b29-b84a-4145-8c10-882bc1aedad9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:56 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b Sep 29 16:46:56 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:56 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.320s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:56 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:46:56 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Deleted volume successfully. Sep 29 16:46:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-292ff0f5-f70a-443a-a9fe-9acd9fa4eca4 tempest-VolumeDependencyTests-929586349 None] Lock "cinder-e370cb89-8577-4960-8022-7ebea5ba0edd-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:57 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b" returned: 0 in 0.436s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:57 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b Sep 29 16:46:57 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:57 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e5585c87-7676-45bb-8ac3-18fe0f24f49b" returned: 0 in 0.268s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Lock "cinder-quobyte-e5585c87-7676-45bb-8ac3-18fe0f24f49b" released by "delete_volume" :: held 0.759s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:46:57 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Created reservations ['fd4babc4-9c4e-4ac3-ae3a-d9531e02b077', 'a3e3d5cd-0311-48c3-8949-842fe44708c7', 'ecd3447c-6051-471a-b574-bc9fcdc89924', '314a00df-fcd9-480b-af1b-0d3fe425b9e3'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:46:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:46:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:46:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:46:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:46:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:46:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:46:57 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:46:57 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:46:58 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Sep 29 16:46:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.490s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:46:58 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:46:58 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Deleted volume successfully. Sep 29 16:46:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6baca199-2433-4bd8-bf3d-33704e19cd27 tempest-VolumeDependencyTests-929586349 None] Lock "cinder-e5585c87-7676-45bb-8ac3-18fe0f24f49b-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Flow 'volume_create_manager' (13f79210-f2dd-43ac-ac60-e96e0bf3abd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb251d3-d895-401c-b964-37baec422455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb251d3-d895-401c-b964-37baec422455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10aaf09e-5863-49b3-90c1-3f8b7752db09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c766fc7b7a46ca8a3b8355cf43fe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:02Z,use_quota=True,user_id='19bd585b99d94ad483ca3f45f6e62f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9081903-3d39-46fd-807f-381180444238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9081903-3d39-46fd-807f-381180444238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ec9329-a586-4233-8e7d-23c67f1f6b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ec9329-a586-4233-8e7d-23c67f1f6b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10aaf09e-5863-49b3-90c1-3f8b7752db09', 'volume_name': 'volume-10aaf09e-5863-49b3-90c1-3f8b7752db09', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3717c90-3126-4be4-aa93-7bdf7dd5ca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3717c90-3126-4be4-aa93-7bdf7dd5ca69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3a0908-d110-48af-8262-c927f1baeb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:01 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Volume 10aaf09e-5863-49b3-90c1-3f8b7752db09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10aaf09e-5863-49b3-90c1-3f8b7752db09', 'volume_size': 1} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10aaf09e-5863-49b3-90c1-3f8b7752db09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c766fc7b7a46ca8a3b8355cf43fe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:02Z,use_quota=True,user_id='19bd585b99d94ad483ca3f45f6e62f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Creating volume 10aaf09e-5863-49b3-90c1-3f8b7752db09 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:47:01 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:47:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10aaf09e-5863-49b3-90c1-3f8b7752db09 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:01 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10aaf09e-5863-49b3-90c1-3f8b7752db09 1073741824 Sep 29 16:47:01 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:02 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10aaf09e-5863-49b3-90c1-3f8b7752db09 1073741824" returned: 0 in 0.498s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10aaf09e-5863-49b3-90c1-3f8b7752db09 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:02 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10aaf09e-5863-49b3-90c1-3f8b7752db09 Sep 29 16:47:02 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:02 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10aaf09e-5863-49b3-90c1-3f8b7752db09" returned: 0 in 0.338s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3a0908-d110-48af-8262-c927f1baeb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10aaf09e-5863-49b3-90c1-3f8b7752db09', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350476ca-0e69-46ab-8d14-1ee78cef21c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:02 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Volume volume-10aaf09e-5863-49b3-90c1-3f8b7752db09 (10aaf09e-5863-49b3-90c1-3f8b7752db09): created successfully Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350476ca-0e69-46ab-8d14-1ee78cef21c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Flow 'volume_create_manager' (13f79210-f2dd-43ac-ac60-e96e0bf3abd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Flow 'volume_create_manager' (bb4e7344-f630-460d-82ad-c690dfd85d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6a93a0-e00d-4dbd-9da8-e49df4155acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:02 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-83916921-c8ec-4580-b41c-5869446263ed tempest-CinderUnicodeTest-890341275 None] Created volume successfully. Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c6a93a0-e00d-4dbd-9da8-e49df4155acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1279644053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49002f7-33a4-4eeb-8efc-aca229bc8713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf07b54392e4a4b8dfc7d060947e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:03Z,use_quota=True,user_id='abcbf081df8347f180d5c676d01f38d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639476a2-d3eb-4ddb-91b2-17b39d4fecb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639476a2-d3eb-4ddb-91b2-17b39d4fecb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e63218-8b6e-4659-abb2-e8d9ebce5d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e63218-8b6e-4659-abb2-e8d9ebce5d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c49002f7-33a4-4eeb-8efc-aca229bc8713', 'volume_name': 'volume-c49002f7-33a4-4eeb-8efc-aca229bc8713', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a685a169-2fe8-402e-9fb4-ac9e585a4824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a685a169-2fe8-402e-9fb4-ac9e585a4824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100df23f-bf26-4165-8336-66bfb51b5a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:02 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Volume c49002f7-33a4-4eeb-8efc-aca229bc8713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c49002f7-33a4-4eeb-8efc-aca229bc8713', 'volume_size': 1} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1279644053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49002f7-33a4-4eeb-8efc-aca229bc8713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eaf07b54392e4a4b8dfc7d060947e4f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:03Z,use_quota=True,user_id='abcbf081df8347f180d5c676d01f38d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Creating volume c49002f7-33a4-4eeb-8efc-aca229bc8713 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:47:02 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:47:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c49002f7-33a4-4eeb-8efc-aca229bc8713 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:02 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c49002f7-33a4-4eeb-8efc-aca229bc8713 1073741824 Sep 29 16:47:02 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:03 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c49002f7-33a4-4eeb-8efc-aca229bc8713 1073741824" returned: 0 in 0.428s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c49002f7-33a4-4eeb-8efc-aca229bc8713 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:03 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c49002f7-33a4-4eeb-8efc-aca229bc8713 Sep 29 16:47:03 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:03 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c49002f7-33a4-4eeb-8efc-aca229bc8713" returned: 0 in 0.247s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:47:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100df23f-bf26-4165-8336-66bfb51b5a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49002f7-33a4-4eeb-8efc-aca229bc8713', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf85a0b-ea67-4959-8a85-c39e769b6815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:03 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Volume volume-c49002f7-33a4-4eeb-8efc-aca229bc8713 (c49002f7-33a4-4eeb-8efc-aca229bc8713): created successfully Sep 29 16:47:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf85a0b-ea67-4959-8a85-c39e769b6815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:03 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Flow 'volume_create_manager' (bb4e7344-f630-460d-82ad-c690dfd85d4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:03 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-93e3765e-eeeb-44fc-80cd-4387442c3bc8 tempest-TestMinimumBasicScenario-1866064707 None] Created volume successfully. Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Flow 'volume_create_manager' (c634c951-f592-4bfa-81e6-102aa8331d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b92331-fa41-4dd6-8a16-a89fb0cde80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b92331-fa41-4dd6-8a16-a89fb0cde80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1173358808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d5444d-6ec4-4aa8-ba36-d6c22659ec95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c766fc7b7a46ca8a3b8355cf43fe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:04Z,use_quota=True,user_id='19bd585b99d94ad483ca3f45f6e62f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26350914-3c5a-47c3-881f-b3a8264c5908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26350914-3c5a-47c3-881f-b3a8264c5908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f27e8eb-7d2b-413c-9851-ac2150aaf9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f27e8eb-7d2b-413c-9851-ac2150aaf9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4d5444d-6ec4-4aa8-ba36-d6c22659ec95', 'volume_name': 'volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f346036c-a84d-4cf3-a194-3e18b9780f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f346036c-a84d-4cf3-a194-3e18b9780f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348f98a0-7313-4400-8103-f4b656192eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:04 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Volume f4d5444d-6ec4-4aa8-ba36-d6c22659ec95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95', 'volume_size': 1} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1173358808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4d5444d-6ec4-4aa8-ba36-d6c22659ec95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88c766fc7b7a46ca8a3b8355cf43fe5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:04Z,use_quota=True,user_id='19bd585b99d94ad483ca3f45f6e62f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Creating volume f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:47:04 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:04 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 1073741824 Sep 29 16:47:04 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:04 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 1073741824" returned: 0 in 0.462s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:04 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 Sep 29 16:47:04 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:05 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95" returned: 0 in 0.277s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:47:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (348f98a0-7313-4400-8103-f4b656192eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9776fe5-95a5-4981-9009-c84d62d80023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:05 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Volume volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 (f4d5444d-6ec4-4aa8-ba36-d6c22659ec95): created successfully Sep 29 16:47:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9776fe5-95a5-4981-9009-c84d62d80023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Flow 'volume_create_manager' (c634c951-f592-4bfa-81e6-102aa8331d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7c2a67b2-05f9-4b49-aea5-c0edf8938bc6 tempest-CinderUnicodeTest-890341275 None] Created volume successfully. Sep 29 16:47:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-0f74c204-3807-4a56-b168-fda939c304c3 req-b34ae5d1-8ead-4d8e-afa2-fe1f4017aaf1 tempest-TestMinimumBasicScenario-1866064707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-0f74c204-3807-4a56-b168-fda939c304c3 req-b34ae5d1-8ead-4d8e-afa2-fe1f4017aaf1 tempest-TestMinimumBasicScenario-1866064707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-0f74c204-3807-4a56-b168-fda939c304c3 req-b34ae5d1-8ead-4d8e-afa2-fe1f4017aaf1 tempest-TestMinimumBasicScenario-1866064707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-0f74c204-3807-4a56-b168-fda939c304c3 req-b34ae5d1-8ead-4d8e-afa2-fe1f4017aaf1 tempest-TestMinimumBasicScenario-1866064707 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-c49002f7-33a4-4eeb-8efc-aca229bc8713', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '071cbf1c-3c12-4c90-a7f3-fd3be5dc31bd', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:47:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-0f74c204-3807-4a56-b168-fda939c304c3 req-b34ae5d1-8ead-4d8e-afa2-fe1f4017aaf1 tempest-TestMinimumBasicScenario-1866064707 None] attachment_update completed successfully. Sep 29 16:47:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] Creating offline snapshot b0658264-e926-478f-a311-2585792b7f3c of volume f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:47:06 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84dd68c-d76c-48ab-be8f-269dbbafa799]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:47:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:06 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 Sep 29 16:47:06 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:07 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95" returned: 0 in 0.393s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:07 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c 1G Sep 29 16:47:07 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:07 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c 1G" returned: 0 in 0.479s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:07 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c Sep 29 16:47:07 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:07 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c" returned: 0 in 0.340s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:08 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c is being set with open permissions: ugo+rw Sep 29 16:47:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:08 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c Sep 29 16:47:08 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:08 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c" returned: 0 in 0.291s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:08 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.info Sep 29 16:47:08 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:08 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.info" returned: 0 in 0.288s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:08 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.info is being set with open permissions: ugo+rw Sep 29 16:47:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:08 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.info Sep 29 16:47:08 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:08 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.info" returned: 0 in 0.286s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.212s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:08 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e8ca800c-7b8d-4f3e-9f63-7b42069c4098 tempest-CinderUnicodeTest-890341275 None] Create snapshot completed successfully Sep 29 16:47:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Acquiring lock "cinder-b0658264-e926-478f-a311-2585792b7f3c-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Lock "cinder-b0658264-e926-478f-a311-2585792b7f3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Acquiring lock "cinder-quobyte-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Lock "cinder-quobyte-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Acquiring lock "cinder-quobyte-b0658264-e926-478f-a311-2585792b7f3c" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Lock "cinder-quobyte-b0658264-e926-478f-a311-2585792b7f3c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:09 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Deleting offline snapshot b0658264-e926-478f-a311-2585792b7f3c of volume f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:47:09 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] snapshot_file for this snap is: volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:47:09 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fa7a73-d60d-4120-9761-5c5b7e7fe4cf]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:47:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:10 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c Sep 29 16:47:10 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:10 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c" returned: 0 in 0.457s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:47:10 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fad24df-1769-42d4-bcde-2036dba14382]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:47:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:10 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 Sep 29 16:47:10 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:10 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95" returned: 0 in 0.519s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:11 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c Sep 29 16:47:11 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:11 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c" returned: 0 in 0.436s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:11 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c Sep 29 16:47:11 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:11 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95.b0658264-e926-478f-a311-2585792b7f3c" returned: 0 in 0.313s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Lock "cinder-quobyte-b0658264-e926-478f-a311-2585792b7f3c" released by "_delete_snapshot" :: held 1.866s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Lock "cinder-quobyte-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95" released by "delete_snapshot" :: held 1.892s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:11 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Created reservations ['2974945a-b971-4a7c-a1aa-7a1ca5000f20', 'dd1d06c7-9e60-4732-a48b-d4d94afd68f2', '1e8ef54c-f6af-48bd-8ba6-d14f453fce95', 'a8b835e8-062d-42b6-9be2-7d8a5284ab0d'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:47:11 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Delete snapshot completed successfully. Sep 29 16:47:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a2d10532-ddec-41aa-995d-794e65e85b07 tempest-CinderUnicodeTest-890341275 None] Lock "cinder-b0658264-e926-478f-a311-2585792b7f3c-delete_snapshot" released by "delete_snapshot" :: held 2.075s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Acquiring lock "cinder-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Lock "cinder-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Acquiring lock "cinder-quobyte-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Lock "cinder-quobyte-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95" acquired by "delete_volume" :: waited 0.028s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:12 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[74678530-0a43-4ace-937e-2de5d67b7cbc]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:47:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:12 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 Sep 29 16:47:12 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:12 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95" returned: 0 in 0.456s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:12 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95 Sep 29 16:47:12 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:13 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95" returned: 0 in 0.313s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Lock "cinder-quobyte-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95" released by "delete_volume" :: held 0.839s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Created reservations ['c57df043-c7f1-49ae-96d1-41dc88fd5d4b', 'a9c6e52f-1bac-4461-ac84-b9383f51e451', '718031b9-e7c8-4e2c-9620-19aa2878e1ef', 'bb209cbc-ef07-45f4-827f-e39d76e0030a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:13 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:47:13 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Acquiring lock "cinder-10aaf09e-5863-49b3-90c1-3f8b7752db09-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Lock "cinder-10aaf09e-5863-49b3-90c1-3f8b7752db09-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Acquiring lock "cinder-quobyte-10aaf09e-5863-49b3-90c1-3f8b7752db09" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Lock "cinder-quobyte-10aaf09e-5863-49b3-90c1-3f8b7752db09" acquired by "delete_volume" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c20655-bb80-40fe-b895-8db6211b2bc1]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10aaf09e-5863-49b3-90c1-3f8b7752db09 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:13 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.389s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:47:13 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Deleted volume successfully. Sep 29 16:47:13 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10aaf09e-5863-49b3-90c1-3f8b7752db09 Sep 29 16:47:13 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-270e5271-74ce-4c77-b329-25cfc073c1a3 tempest-CinderUnicodeTest-890341275 None] Lock "cinder-f4d5444d-6ec4-4aa8-ba36-d6c22659ec95-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:13 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10aaf09e-5863-49b3-90c1-3f8b7752db09" returned: 0 in 0.412s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10aaf09e-5863-49b3-90c1-3f8b7752db09 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:13 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10aaf09e-5863-49b3-90c1-3f8b7752db09 Sep 29 16:47:13 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:14 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-10aaf09e-5863-49b3-90c1-3f8b7752db09" returned: 0 in 0.280s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Lock "cinder-quobyte-10aaf09e-5863-49b3-90c1-3f8b7752db09" released by "delete_volume" :: held 0.753s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:14 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Created reservations ['a8df3fe0-b520-447c-aaf3-9e4daca98f97', '07f402a7-655f-41f8-97c2-22472b6c1013', 'fc21cba3-4bc7-4e4b-8ea8-535a237bf232', 'c1a42ffe-2358-4d7c-b312-e43e9ed36db7'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:47:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:14 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:47:14 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:14 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.299s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:14 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:47:14 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Deleted volume successfully. Sep 29 16:47:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ee86e595-8d4a-4554-8e68-0a941972f758 tempest-CinderUnicodeTest-890341275 None] Lock "cinder-10aaf09e-5863-49b3-90c1-3f8b7752db09-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Flow 'volume_create_manager' (013c5845-d149-4a71-8116-00ce8aa62add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649ddb54-764f-4257-9ed2-32c01a334386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (649ddb54-764f-4257-9ed2-32c01a334386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1611251850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c97db2-357f-449c-bd85-da633f7731ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ab3c0064294037abf9e3581960028b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:22Z,use_quota=True,user_id='f12c0a2ae37743e8b808cba6612e8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f71a2cf-e710-4e69-a43f-a9405589e439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f71a2cf-e710-4e69-a43f-a9405589e439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4827f149-b2a3-4499-8cc2-050026377b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4827f149-b2a3-4499-8cc2-050026377b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c97db2-357f-449c-bd85-da633f7731ff', 'volume_name': 'volume-09c97db2-357f-449c-bd85-da633f7731ff', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36febafa-6a74-4f7b-873b-d2d062f0a118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36febafa-6a74-4f7b-873b-d2d062f0a118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9664d1ae-9be4-466e-bf4c-d3717dbf0a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:21 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Volume 09c97db2-357f-449c-bd85-da633f7731ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c97db2-357f-449c-bd85-da633f7731ff', 'volume_size': 1} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1611251850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c97db2-357f-449c-bd85-da633f7731ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ab3c0064294037abf9e3581960028b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:22Z,use_quota=True,user_id='f12c0a2ae37743e8b808cba6612e8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Creating volume 09c97db2-357f-449c-bd85-da633f7731ff {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:47:21 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:47:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-09c97db2-357f-449c-bd85-da633f7731ff 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:21 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-09c97db2-357f-449c-bd85-da633f7731ff 1073741824 Sep 29 16:47:21 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:22 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-09c97db2-357f-449c-bd85-da633f7731ff 1073741824" returned: 0 in 0.407s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-09c97db2-357f-449c-bd85-da633f7731ff {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:22 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-09c97db2-357f-449c-bd85-da633f7731ff Sep 29 16:47:22 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:22 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-09c97db2-357f-449c-bd85-da633f7731ff" returned: 0 in 0.290s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:47:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9664d1ae-9be4-466e-bf4c-d3717dbf0a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c97db2-357f-449c-bd85-da633f7731ff', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85d3721-46c5-4827-b026-2cda3beda735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:22 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Volume volume-09c97db2-357f-449c-bd85-da633f7731ff (09c97db2-357f-449c-bd85-da633f7731ff): created successfully Sep 29 16:47:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85d3721-46c5-4827-b026-2cda3beda735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:22 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Flow 'volume_create_manager' (013c5845-d149-4a71-8116-00ce8aa62add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:22 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-50adf008-76ad-4edb-b385-9fc5677fb263 tempest-ProjectReaderTests-1654010673 None] Created volume successfully. Sep 29 16:47:22 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Acquiring lock "cinder-09c97db2-357f-449c-bd85-da633f7731ff-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:22 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Lock "cinder-09c97db2-357f-449c-bd85-da633f7731ff-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Acquiring lock "cinder-quobyte-09c97db2-357f-449c-bd85-da633f7731ff" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Lock "cinder-quobyte-09c97db2-357f-449c-bd85-da633f7731ff" acquired by "delete_volume" :: waited 0.013s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9515fec0-f15c-4049-b75f-729984a4c155]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-09c97db2-357f-449c-bd85-da633f7731ff {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:23 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-09c97db2-357f-449c-bd85-da633f7731ff Sep 29 16:47:23 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:23 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-09c97db2-357f-449c-bd85-da633f7731ff" returned: 0 in 0.395s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-09c97db2-357f-449c-bd85-da633f7731ff {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:23 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-09c97db2-357f-449c-bd85-da633f7731ff Sep 29 16:47:23 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:23 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-09c97db2-357f-449c-bd85-da633f7731ff" returned: 0 in 0.280s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Lock "cinder-quobyte-09c97db2-357f-449c-bd85-da633f7731ff" released by "delete_volume" :: held 0.726s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Created reservations ['75b9e28f-8e37-4d3d-9e0a-051369935fe3', '262087d6-240d-4a06-a6c1-947aa106b87e', '7f79b04d-79b5-49aa-be8e-34fc4a7952d8', 'fc865c93-e3a3-4b6f-9546-61521242804d'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:23 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:47:23 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:24 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.252s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:47:24 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Deleted volume successfully. Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-125da37f-bdbe-40ed-a7fa-9f529ad7d8bc tempest-ProjectReaderTests-1654010673 None] Lock "cinder-09c97db2-357f-449c-bd85-da633f7731ff-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Flow 'volume_create_manager' (edb8f67a-4afb-42f4-8a3b-daf8263ef6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54cbcfe1-1ab6-4789-b970-41061e3553d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54cbcfe1-1ab6-4789-b970-41061e3553d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1276273781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd1c267-f078-41e8-ac94-7b5028853ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ab3c0064294037abf9e3581960028b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:25Z,use_quota=True,user_id='f12c0a2ae37743e8b808cba6612e8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b73acb-7393-4424-b692-69a601cb03cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b73acb-7393-4424-b692-69a601cb03cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daad0bb9-4770-402f-8072-3078809608eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daad0bb9-4770-402f-8072-3078809608eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dd1c267-f078-41e8-ac94-7b5028853ba5', 'volume_name': 'volume-9dd1c267-f078-41e8-ac94-7b5028853ba5', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00d5ef7-9817-47c6-bcf8-b4ee9ece2a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00d5ef7-9817-47c6-bcf8-b4ee9ece2a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f63ed712-8b65-48ca-a966-c1453a3fdea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:24 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Volume 9dd1c267-f078-41e8-ac94-7b5028853ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dd1c267-f078-41e8-ac94-7b5028853ba5', 'volume_size': 1} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1276273781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd1c267-f078-41e8-ac94-7b5028853ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ab3c0064294037abf9e3581960028b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:25Z,use_quota=True,user_id='f12c0a2ae37743e8b808cba6612e8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Creating volume 9dd1c267-f078-41e8-ac94-7b5028853ba5 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:47:24 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:47:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9dd1c267-f078-41e8-ac94-7b5028853ba5 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:24 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9dd1c267-f078-41e8-ac94-7b5028853ba5 1073741824 Sep 29 16:47:24 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:25 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9dd1c267-f078-41e8-ac94-7b5028853ba5 1073741824" returned: 0 in 0.444s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9dd1c267-f078-41e8-ac94-7b5028853ba5 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:25 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9dd1c267-f078-41e8-ac94-7b5028853ba5 Sep 29 16:47:25 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:25 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9dd1c267-f078-41e8-ac94-7b5028853ba5" returned: 0 in 0.262s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:47:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f63ed712-8b65-48ca-a966-c1453a3fdea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd1c267-f078-41e8-ac94-7b5028853ba5', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4de5992-afd0-4bde-bccd-59347cb01ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:25 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Volume volume-9dd1c267-f078-41e8-ac94-7b5028853ba5 (9dd1c267-f078-41e8-ac94-7b5028853ba5): created successfully Sep 29 16:47:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4de5992-afd0-4bde-bccd-59347cb01ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Flow 'volume_create_manager' (edb8f67a-4afb-42f4-8a3b-daf8263ef6ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:25 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-08ce26bb-cd6d-4649-8db8-a05205abda30 tempest-ProjectReaderTests-1654010673 None] Created volume successfully. Sep 29 16:47:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Acquiring lock "cinder-9dd1c267-f078-41e8-ac94-7b5028853ba5-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Lock "cinder-9dd1c267-f078-41e8-ac94-7b5028853ba5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Acquiring lock "cinder-quobyte-9dd1c267-f078-41e8-ac94-7b5028853ba5" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Lock "cinder-quobyte-9dd1c267-f078-41e8-ac94-7b5028853ba5" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:26 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a03667-1458-4b6e-bb15-8c999c337500]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:47:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9dd1c267-f078-41e8-ac94-7b5028853ba5 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:26 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9dd1c267-f078-41e8-ac94-7b5028853ba5 Sep 29 16:47:26 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:27 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9dd1c267-f078-41e8-ac94-7b5028853ba5" returned: 0 in 0.356s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9dd1c267-f078-41e8-ac94-7b5028853ba5 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:27 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9dd1c267-f078-41e8-ac94-7b5028853ba5 Sep 29 16:47:27 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:27 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9dd1c267-f078-41e8-ac94-7b5028853ba5" returned: 0 in 0.256s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Lock "cinder-quobyte-9dd1c267-f078-41e8-ac94-7b5028853ba5" released by "delete_volume" :: held 0.657s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:27 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Created reservations ['51e2df45-f26b-4e7c-9bd7-81b38e5b0f39', 'ee64c9bd-efc2-49d1-9cbc-a52fabef6d89', '337e0b1c-a778-4884-a1c7-353e78fb33e5', '37e5df1d-8f89-4acc-be6d-4c0be3b0bd1f'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:47:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:27 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:47:27 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:27 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.268s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:27 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:47:27 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Deleted volume successfully. Sep 29 16:47:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f6a88c1c-c600-45ac-a6df-fcf3c2718750 tempest-ProjectReaderTests-1654010673 None] Lock "cinder-9dd1c267-f078-41e8-ac94-7b5028853ba5-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Flow 'volume_create_manager' (d8397732-95f7-4fcc-b7be-1b0e18fe5c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd3cc48-44c0-4185-a811-fd55a89d6a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd3cc48-44c0-4185-a811-fd55a89d6a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603430427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ab3c0064294037abf9e3581960028b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:28Z,use_quota=True,user_id='f12c0a2ae37743e8b808cba6612e8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213d489d-18db-471b-baee-73aca1ee156d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213d489d-18db-471b-baee-73aca1ee156d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351746b7-de69-43f7-bad6-73fc3092476f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351746b7-de69-43f7-bad6-73fc3092476f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed', 'volume_name': 'volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f91fec-a10d-405e-9dc1-e9a5260efb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f91fec-a10d-405e-9dc1-e9a5260efb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d8b2de-7aa3-4f32-add1-ff59c1c43f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:28 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Volume 7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed', 'volume_size': 1} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603430427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ab3c0064294037abf9e3581960028b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:28Z,use_quota=True,user_id='f12c0a2ae37743e8b808cba6612e8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Creating volume 7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:47:28 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:28 devstack sudo[104830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed 1073741824 Sep 29 16:47:28 devstack sudo[104830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:28 devstack sudo[104830]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed 1073741824" returned: 0 in 0.470s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:28 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed Sep 29 16:47:28 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:29 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed" returned: 0 in 0.248s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:29 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:47:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d8b2de-7aa3-4f32-add1-ff59c1c43f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881e498f-8a2d-4ee9-a770-7679a4e2e408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:29 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Volume volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed (7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed): created successfully Sep 29 16:47:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881e498f-8a2d-4ee9-a770-7679a4e2e408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Flow 'volume_create_manager' (d8397732-95f7-4fcc-b7be-1b0e18fe5c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:29 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-404505af-07aa-48a1-8378-b9b57a6e06e9 tempest-ProjectReaderTests-1654010673 None] Created volume successfully. Sep 29 16:47:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Acquiring lock "cinder-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Lock "cinder-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Acquiring lock "cinder-quobyte-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Lock "cinder-quobyte-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:30 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f11a01a-f5c4-44b8-b0e3-f97dbc79d8da]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:47:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:30 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed Sep 29 16:47:30 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:31 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed" returned: 0 in 0.402s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:31 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed Sep 29 16:47:31 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:31 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed" returned: 0 in 0.260s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Lock "cinder-quobyte-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed" released by "delete_volume" :: held 0.745s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:31 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Created reservations ['83ddbfdb-0354-4cb8-81fa-94aeef709904', 'a7fd7265-0b29-4585-a4ad-eb2398e00e36', 'f5b6abe6-fa2a-4bcc-a593-e79e6c3d9a28', '7cbcc3a1-91b9-444d-9799-3562d752897e'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:47:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:31 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:47:31 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:31 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.266s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:31 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:47:31 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Deleted volume successfully. Sep 29 16:47:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ad7371e-a0f0-4ed0-abd1-9d696ba57f62 tempest-ProjectReaderTests-1654010673 None] Lock "cinder-7ac2e814-2b07-4fb4-923c-55ac3f3ab1ed-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Flow 'volume_create_manager' (c95ea05e-4238-4c7a-857b-2b1dbbd70297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1c0a19-9325-4db5-bb1c-d33cc27a6cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1c0a19-9325-4db5-bb1c-d33cc27a6cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-835501351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1537472a-781f-4d2d-a1ad-3b365082556e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ab3c0064294037abf9e3581960028b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:32Z,use_quota=True,user_id='f12c0a2ae37743e8b808cba6612e8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe65aa8-066c-493b-858c-176e6688ade4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fe65aa8-066c-493b-858c-176e6688ade4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2683ad8b-118a-4e5a-8dd1-db4bb6e9ede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2683ad8b-118a-4e5a-8dd1-db4bb6e9ede7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1537472a-781f-4d2d-a1ad-3b365082556e', 'volume_name': 'volume-1537472a-781f-4d2d-a1ad-3b365082556e', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75acfcc6-3885-424d-9d44-08bd34a1faf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75acfcc6-3885-424d-9d44-08bd34a1faf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcbe269f-dedc-4259-aab1-9d7464cb6019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:32 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Volume 1537472a-781f-4d2d-a1ad-3b365082556e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1537472a-781f-4d2d-a1ad-3b365082556e', 'volume_size': 1} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-835501351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1537472a-781f-4d2d-a1ad-3b365082556e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ab3c0064294037abf9e3581960028b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:32Z,use_quota=True,user_id='f12c0a2ae37743e8b808cba6612e8b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Creating volume 1537472a-781f-4d2d-a1ad-3b365082556e {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:47:32 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1537472a-781f-4d2d-a1ad-3b365082556e 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:32 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1537472a-781f-4d2d-a1ad-3b365082556e 1073741824 Sep 29 16:47:32 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:32 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1537472a-781f-4d2d-a1ad-3b365082556e 1073741824" returned: 0 in 0.454s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1537472a-781f-4d2d-a1ad-3b365082556e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:32 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1537472a-781f-4d2d-a1ad-3b365082556e Sep 29 16:47:32 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:33 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1537472a-781f-4d2d-a1ad-3b365082556e" returned: 0 in 0.257s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:47:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcbe269f-dedc-4259-aab1-9d7464cb6019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1537472a-781f-4d2d-a1ad-3b365082556e', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08496124-9839-44cd-97d9-cca36d652d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:33 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Volume volume-1537472a-781f-4d2d-a1ad-3b365082556e (1537472a-781f-4d2d-a1ad-3b365082556e): created successfully Sep 29 16:47:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08496124-9839-44cd-97d9-cca36d652d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Flow 'volume_create_manager' (c95ea05e-4238-4c7a-857b-2b1dbbd70297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:33 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-288c639d-044f-426c-babb-0b6cd80a6710 tempest-ProjectReaderTests-1654010673 None] Created volume successfully. Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Acquiring lock "cinder-1537472a-781f-4d2d-a1ad-3b365082556e-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Lock "cinder-1537472a-781f-4d2d-a1ad-3b365082556e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Acquiring lock "cinder-quobyte-1537472a-781f-4d2d-a1ad-3b365082556e" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Lock "cinder-quobyte-1537472a-781f-4d2d-a1ad-3b365082556e" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b5c9df-9022-4f61-801e-ceb1f5c59dda]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1537472a-781f-4d2d-a1ad-3b365082556e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:34 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1537472a-781f-4d2d-a1ad-3b365082556e Sep 29 16:47:34 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:34 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:47:34 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:34 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1537472a-781f-4d2d-a1ad-3b365082556e" returned: 0 in 0.370s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1537472a-781f-4d2d-a1ad-3b365082556e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:34 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1537472a-781f-4d2d-a1ad-3b365082556e Sep 29 16:47:34 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:35 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.271s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:47:35 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1537472a-781f-4d2d-a1ad-3b365082556e" returned: 0 in 0.247s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Lock "cinder-quobyte-1537472a-781f-4d2d-a1ad-3b365082556e" released by "delete_volume" :: held 0.656s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Created reservations ['cf54e59b-45a4-48d9-bb56-0924ab4bf6bc', '8bb5ef24-7138-454b-abdb-fdeb9d3470b1', 'c8c2fba0-841e-4b30-9b99-d24178a20c69', 'ec76f1f0-329c-424b-9bf1-85e973ed8bdc'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:35 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:47:35 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:35 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.248s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:47:35 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Deleted volume successfully. Sep 29 16:47:35 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7beca6e5-dbcc-4d2b-a353-b222143d8faa tempest-ProjectReaderTests-1654010673 None] Lock "cinder-1537472a-781f-4d2d-a1ad-3b365082556e-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:45 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=86,cinder:UPDATE=106,cinder:DELETE=8,cinder:INSERT=18 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:47:45 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=82,cinder:UPDATE=107,cinder:INSERT=33,cinder:DELETE=11 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:47:54 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-205ef392-0d03-4779-b488-8ff2a09b8035 req-75a28198-7297-4009-9e16-73940290a94f tempest-TestMinimumBasicScenario-1866064707 None] Terminate volume connection completed successfully. Sep 29 16:47:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-205ef392-0d03-4779-b488-8ff2a09b8035 req-75a28198-7297-4009-9e16-73940290a94f tempest-TestMinimumBasicScenario-1866064707 None] Deleting attachment 071cbf1c-3c12-4c90-a7f3-fd3be5dc31bd. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:47:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Acquiring lock "cinder-c49002f7-33a4-4eeb-8efc-aca229bc8713-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Lock "cinder-c49002f7-33a4-4eeb-8efc-aca229bc8713-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Acquiring lock "cinder-quobyte-c49002f7-33a4-4eeb-8efc-aca229bc8713" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:47:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Lock "cinder-quobyte-c49002f7-33a4-4eeb-8efc-aca229bc8713" acquired by "delete_volume" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:47:55 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce1a861-041d-4e8d-80ce-7fc1775ed09d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:47:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c49002f7-33a4-4eeb-8efc-aca229bc8713 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:55 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c49002f7-33a4-4eeb-8efc-aca229bc8713 Sep 29 16:47:55 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:55 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c49002f7-33a4-4eeb-8efc-aca229bc8713" returned: 0 in 0.444s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c49002f7-33a4-4eeb-8efc-aca229bc8713 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:55 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c49002f7-33a4-4eeb-8efc-aca229bc8713 Sep 29 16:47:55 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:56 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c49002f7-33a4-4eeb-8efc-aca229bc8713" returned: 0 in 0.284s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Lock "cinder-quobyte-c49002f7-33a4-4eeb-8efc-aca229bc8713" released by "delete_volume" :: held 0.796s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:56 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Created reservations ['64d698a1-3806-49e5-85ae-9ebd3b9e34aa', '81c9a0b5-905e-47ff-914b-7a3ab8a0564a', 'c67e57e2-70ee-4017-94a3-cd7940761c9a', '0ceb2e6f-44b9-4360-9c4e-4c957304d717'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:47:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:56 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:47:56 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:56 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.344s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:56 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:47:56 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Deleted volume successfully. Sep 29 16:47:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-4ddf3503-c085-4949-8fd1-bec471e5749e tempest-TestMinimumBasicScenario-1866064707 None] Lock "cinder-c49002f7-33a4-4eeb-8efc-aca229bc8713-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Flow 'volume_create_manager' (ee7833cf-8533-4279-a9f6-b991cd10d6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a32e10a-bc0d-478f-8378-47e93318ca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a32e10a-bc0d-478f-8378-47e93318ca80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-706769164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deed173a-b3cb-43ec-a20e-2b8abace5126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380991de81c40fa94bea7c055457fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:58Z,use_quota=True,user_id='01fa1e773a1a40f896a66e8dbd5e0e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007a9f53-b707-453f-bddd-7075e4da0a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007a9f53-b707-453f-bddd-7075e4da0a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e3a4a3-99fa-4941-a621-253b8a2b5f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19e3a4a3-99fa-4941-a621-253b8a2b5f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deed173a-b3cb-43ec-a20e-2b8abace5126', 'volume_name': 'volume-deed173a-b3cb-43ec-a20e-2b8abace5126', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44647b46-3afb-4318-85b7-d6a0ee469817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44647b46-3afb-4318-85b7-d6a0ee469817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294ed588-4fee-4959-aa33-344f35b643b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:58 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Volume deed173a-b3cb-43ec-a20e-2b8abace5126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deed173a-b3cb-43ec-a20e-2b8abace5126', 'volume_size': 1} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-706769164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deed173a-b3cb-43ec-a20e-2b8abace5126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380991de81c40fa94bea7c055457fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:47:58Z,use_quota=True,user_id='01fa1e773a1a40f896a66e8dbd5e0e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Creating volume deed173a-b3cb-43ec-a20e-2b8abace5126 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:47:58 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:58 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 1073741824 Sep 29 16:47:58 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:58 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 1073741824" returned: 0 in 0.574s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:47:58 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 Sep 29 16:47:58 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:47:59 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Sep 29 16:47:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126" returned: 0 in 0.280s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:47:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:47:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:47:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294ed588-4fee-4959-aa33-344f35b643b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deed173a-b3cb-43ec-a20e-2b8abace5126', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0321deee-f502-4b2f-9ac2-3c224b15b2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:47:59 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Volume volume-deed173a-b3cb-43ec-a20e-2b8abace5126 (deed173a-b3cb-43ec-a20e-2b8abace5126): created successfully Sep 29 16:47:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0321deee-f502-4b2f-9ac2-3c224b15b2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:47:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Flow 'volume_create_manager' (ee7833cf-8533-4279-a9f6-b991cd10d6a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:47:59 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c29c4d20-f3d9-4217-be75-4ad77e46526f tempest-SnapshotDependencyTests-175767088 None] Created volume successfully. Sep 29 16:48:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:48:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:48:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] Creating offline snapshot db40cc29-a27f-4cd0-8cf9-ba445d94c083 of volume deed173a-b3cb-43ec-a20e-2b8abace5126 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:48:00 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8341f213-f821-4404-b909-168462b418ff]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:48:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:00 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 Sep 29 16:48:00 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:00 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126" returned: 0 in 0.398s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:00 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 1G Sep 29 16:48:00 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:01 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 1G" returned: 0 in 0.419s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deed173a-b3cb-43ec-a20e-2b8abace5126 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:01 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deed173a-b3cb-43ec-a20e-2b8abace5126 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 Sep 29 16:48:01 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:01 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-deed173a-b3cb-43ec-a20e-2b8abace5126 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083" returned: 0 in 0.321s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:01 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 is being set with open permissions: ugo+rw Sep 29 16:48:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:01 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 Sep 29 16:48:01 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:01 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083" returned: 0 in 0.269s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:01 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.info Sep 29 16:48:01 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:02 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.info" returned: 0 in 0.245s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:02 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.info is being set with open permissions: ugo+rw Sep 29 16:48:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:02 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.info Sep 29 16:48:02 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:02 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.info" returned: 0 in 0.261s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:48:02 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1f3b876a-760c-4d10-b2f4-0e12d1b8ca7f tempest-SnapshotDependencyTests-175767088 None] Create snapshot completed successfully Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Flow 'volume_create_manager' (5309a125-b430-486d-a6d3-69d2b13f0119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042f80a1-e35f-45d2-929f-3a70a44f1151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042f80a1-e35f-45d2-929f-3a70a44f1151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac7dbb77-8f94-4df6-9988-754e1789a75b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7380991de81c40fa94bea7c055457fc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=db40cc29-a27f-4cd0-8cf9-ba445d94c083,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:04Z,use_quota=True,user_id='01fa1e773a1a40f896a66e8dbd5e0e60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5329c7-d94d-43c3-bd6b-6ab38007f2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5329c7-d94d-43c3-bd6b-6ab38007f2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f9e144-bf19-4bd9-b27d-d61ab36a2117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f9e144-bf19-4bd9-b27d-d61ab36a2117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ac7dbb77-8f94-4df6-9988-754e1789a75b', 'volume_name': 'volume-ac7dbb77-8f94-4df6-9988-754e1789a75b', 'volume_size': 1, 'snapshot_id': 'db40cc29-a27f-4cd0-8cf9-ba445d94c083'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba578be2-b3a0-4b91-868c-9d76de8b50d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba578be2-b3a0-4b91-868c-9d76de8b50d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd0e5fb-0d2f-48bd-8027-71d064be412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:48:04 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Volume ac7dbb77-8f94-4df6-9988-754e1789a75b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ac7dbb77-8f94-4df6-9988-754e1789a75b', 'volume_size': 1, 'snapshot_id': 'db40cc29-a27f-4cd0-8cf9-ba445d94c083'} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "cinder-quobyte-db40cc29-a27f-4cd0-8cf9-ba445d94c083-ac7dbb77-8f94-4df6-9988-754e1789a75b" by "_create_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-quobyte-db40cc29-a27f-4cd0-8cf9-ba445d94c083-ac7dbb77-8f94-4df6-9988-754e1789a75b" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Creating volume ac7dbb77-8f94-4df6-9988-754e1789a75b from snapshot db40cc29-a27f-4cd0-8cf9-ba445d94c083 {{(pid=86793) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "cinder-quobyte-ac7dbb77-8f94-4df6-9988-754e1789a75b" by "_copy_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-quobyte-ac7dbb77-8f94-4df6-9988-754e1789a75b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] snapshot: db40cc29-a27f-4cd0-8cf9-ba445d94c083, volume: ac7dbb77-8f94-4df6-9988-754e1789a75b, {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[876df27e-e4c6-4b39-8fa9-91ca677ed62a]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:04 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 Sep 29 16:48:04 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:04 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083" returned: 0 in 0.377s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deed173a-b3cb-43ec-a20e-2b8abace5126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac33f8b-aa60-45b0-b8d5-c0728c2d6795]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:48:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:04 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 Sep 29 16:48:04 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:05 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126" returned: 0 in 0.416s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] will copy from snapshot at /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 16:48:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Creating direct copy from snapshot {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 16:48:05 devstack cinder-volume[86793]: DEBUG cinder.utils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Path /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b not found in is_blk_device check {{(pid=86793) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 16:48:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:05 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b Sep 29 16:48:05 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:12 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b" returned: 0 in 7.103s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:12 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126, size 1024.00 MB, duration 7.10 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:48:12 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Converted 1024.00 MB image at 144.13 MB/s Sep 29 16:48:12 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b is being set with open permissions: ugo+rw Sep 29 16:48:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:12 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b Sep 29 16:48:12 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:12 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b" returned: 0 in 0.278s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-quobyte-ac7dbb77-8f94-4df6-9988-754e1789a75b" released by "_copy_volume_from_snapshot" :: held 8.268s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:48:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-quobyte-db40cc29-a27f-4cd0-8cf9-ba445d94c083-ac7dbb77-8f94-4df6-9988-754e1789a75b" released by "_create_volume_from_snapshot" :: held 8.338s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:48:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.353s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:48:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd0e5fb-0d2f-48bd-8027-71d064be412f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac7dbb77-8f94-4df6-9988-754e1789a75b', 'volume_size': 1, 'snapshot_id': 'db40cc29-a27f-4cd0-8cf9-ba445d94c083'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:48:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8b0b9f-5693-48d5-899a-47bd01b83ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:48:12 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Volume volume-ac7dbb77-8f94-4df6-9988-754e1789a75b (ac7dbb77-8f94-4df6-9988-754e1789a75b): created successfully Sep 29 16:48:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b8b0b9f-5693-48d5-899a-47bd01b83ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:48:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Flow 'volume_create_manager' (5309a125-b430-486d-a6d3-69d2b13f0119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:48:12 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-6afcd4a4-1624-4a26-b414-ddad56bc66c8 tempest-SnapshotDependencyTests-175767088 None] Created volume successfully. Sep 29 16:48:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "cinder-db40cc29-a27f-4cd0-8cf9-ba445d94c083-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:48:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-db40cc29-a27f-4cd0-8cf9-ba445d94c083-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:48:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "cinder-quobyte-deed173a-b3cb-43ec-a20e-2b8abace5126" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:48:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-quobyte-deed173a-b3cb-43ec-a20e-2b8abace5126" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:48:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "cinder-quobyte-db40cc29-a27f-4cd0-8cf9-ba445d94c083" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:48:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-quobyte-db40cc29-a27f-4cd0-8cf9-ba445d94c083" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:48:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Deleting offline snapshot db40cc29-a27f-4cd0-8cf9-ba445d94c083 of volume deed173a-b3cb-43ec-a20e-2b8abace5126 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:48:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] snapshot_file for this snap is: volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:48:13 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7596441-30f5-4940-b7de-acd48559dba3]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:48:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:13 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 Sep 29 16:48:13 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:13 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083" returned: 0 in 0.363s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-deed173a-b3cb-43ec-a20e-2b8abace5126(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:48:13 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10c30b3-778d-455b-8f79-d78d459a4c75]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:48:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:13 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 Sep 29 16:48:13 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:14 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126" returned: 0 in 0.544s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:14 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 Sep 29 16:48:14 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:14 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083" returned: 0 in 0.364s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:14 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083 Sep 29 16:48:14 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:14 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126.db40cc29-a27f-4cd0-8cf9-ba445d94c083" returned: 0 in 0.250s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-quobyte-db40cc29-a27f-4cd0-8cf9-ba445d94c083" released by "_delete_snapshot" :: held 1.655s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:48:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-quobyte-deed173a-b3cb-43ec-a20e-2b8abace5126" released by "delete_snapshot" :: held 1.681s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:48:14 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Created reservations ['f1b404b4-bb27-4708-b50d-b7035a781d35', '662ef01e-0228-4cee-8941-bb10b28cac88', 'b59c360a-5631-4434-9736-5e1015cf1575', 'da2aa72a-352a-40ac-9bac-42e9463f36f5'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:48:14 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Delete snapshot completed successfully. Sep 29 16:48:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9734445d-48b1-4754-b670-9006c7269c13 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-db40cc29-a27f-4cd0-8cf9-ba445d94c083-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:48:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "cinder-deed173a-b3cb-43ec-a20e-2b8abace5126-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:48:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-deed173a-b3cb-43ec-a20e-2b8abace5126-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:48:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "cinder-quobyte-deed173a-b3cb-43ec-a20e-2b8abace5126" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:48:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-quobyte-deed173a-b3cb-43ec-a20e-2b8abace5126" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:48:15 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dbb3c7-b3b6-4d0e-aa6a-52c4bbc73ca8]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:48:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:15 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 Sep 29 16:48:15 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:15 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126" returned: 0 in 0.376s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:15 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126 Sep 29 16:48:15 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:15 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-deed173a-b3cb-43ec-a20e-2b8abace5126" returned: 0 in 0.253s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-quobyte-deed173a-b3cb-43ec-a20e-2b8abace5126" released by "delete_volume" :: held 0.711s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:48:15 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Created reservations ['30750ce9-e83b-4b0e-b967-d5dfe11c26ba', '3dc9cc83-7068-4282-a4dc-0f11cb21e8a2', '9a816c41-1767-44c4-9351-b266a67b25ec', '51fddf0c-8a35-4b74-9131-6b3352b570ad'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:16 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:48:16 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:16 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.252s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "cinder-ac7dbb77-8f94-4df6-9988-754e1789a75b-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:48:16 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Deleted volume successfully. Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-ac7dbb77-8f94-4df6-9988-754e1789a75b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-7bb8b0fe-f3b1-4098-93ba-e5c580bff4c5 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-deed173a-b3cb-43ec-a20e-2b8abace5126-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "cinder-quobyte-ac7dbb77-8f94-4df6-9988-754e1789a75b" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-quobyte-ac7dbb77-8f94-4df6-9988-754e1789a75b" acquired by "delete_volume" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[43551fcd-49f0-4579-af7d-bef6a13433b3]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:16 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b Sep 29 16:48:16 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:16 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b" returned: 0 in 0.375s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:16 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b Sep 29 16:48:16 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:17 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac7dbb77-8f94-4df6-9988-754e1789a75b" returned: 0 in 0.259s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-quobyte-ac7dbb77-8f94-4df6-9988-754e1789a75b" released by "delete_volume" :: held 0.679s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:48:17 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Created reservations ['852ecbd1-5dc2-4de3-905c-5dd34bcf22e6', 'c5749863-1272-45ae-9b15-bcb61842889e', '6ccb9442-4aac-43c6-89ed-17b9c7c5a231', 'f8270528-25ce-4226-bf20-ba1cf4c1ebb4'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:48:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:48:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:48:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:48:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:48:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:48:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:17 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:48:17 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:17 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.251s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:17 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:48:17 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Deleted volume successfully. Sep 29 16:48:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c833ae86-b8b5-4b5a-938b-a0613e85d201 tempest-SnapshotDependencyTests-175767088 None] Lock "cinder-ac7dbb77-8f94-4df6-9988-754e1789a75b-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:48:27 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=33,cinder:INSERT=11,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:48:27 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=29,cinder:UPDATE=41,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:48:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:48:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:48:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:48:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:48:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:48:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:48:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:34 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:48:34 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:35 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.250s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:48:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:48:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:48:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Flow 'volume_create_manager' (70f4fefb-94fc-4285-b727-30c1dd456701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc79717-886d-4c41-b94d-278fa2b0e9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc79717-886d-4c41-b94d-278fa2b0e9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1216811325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788599f1-d9d2-45a4-b748-3679ccd47feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d73e61dbfbd407f94e92773831a66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:36Z,use_quota=True,user_id='b1d34a566cf74c668f12d0b536f3f3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117eb8d0-4525-4ae2-a537-431d5f3c606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117eb8d0-4525-4ae2-a537-431d5f3c606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb280d5-70cd-4fcb-a37c-36dac698191e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fb280d5-70cd-4fcb-a37c-36dac698191e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '788599f1-d9d2-45a4-b748-3679ccd47feb', 'volume_name': 'volume-788599f1-d9d2-45a4-b748-3679ccd47feb', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e5ea4a-3160-44de-9c83-d8b1913e5f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26e5ea4a-3160-44de-9c83-d8b1913e5f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36563f13-b625-4fe4-8f50-733264796be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:48:36 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Volume 788599f1-d9d2-45a4-b748-3679ccd47feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-788599f1-d9d2-45a4-b748-3679ccd47feb', 'volume_size': 1} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1216811325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788599f1-d9d2-45a4-b748-3679ccd47feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d73e61dbfbd407f94e92773831a66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:48:36Z,use_quota=True,user_id='b1d34a566cf74c668f12d0b536f3f3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Creating volume 788599f1-d9d2-45a4-b748-3679ccd47feb {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:48:36 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:36 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb 1073741824 Sep 29 16:48:36 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:36 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb 1073741824" returned: 0 in 0.457s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:48:36 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb Sep 29 16:48:36 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:48:36 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Sep 29 16:48:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb" returned: 0 in 0.286s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:48:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:48:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:48:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36563f13-b625-4fe4-8f50-733264796be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-788599f1-d9d2-45a4-b748-3679ccd47feb', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:48:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cd33b3-3181-4aa8-9535-688891d0c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:48:37 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Volume volume-788599f1-d9d2-45a4-b748-3679ccd47feb (788599f1-d9d2-45a4-b748-3679ccd47feb): created successfully Sep 29 16:48:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91cd33b3-3181-4aa8-9535-688891d0c200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:48:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Flow 'volume_create_manager' (70f4fefb-94fc-4285-b727-30c1dd456701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:48:37 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-957188c9-8c99-4809-8bfe-9d4151db9be1 tempest-TestStampPattern-1275508992 None] Created volume successfully. Sep 29 16:48:47 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:48:47 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:49:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-8c233cb9-ac05-48ee-bd40-d19eb5255fd2 req-c2bec6d7-31c8-4b06-85b8-3b16c9d4b335 tempest-TestStampPattern-1275508992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:49:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-8c233cb9-ac05-48ee-bd40-d19eb5255fd2 req-c2bec6d7-31c8-4b06-85b8-3b16c9d4b335 tempest-TestStampPattern-1275508992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:49:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-8c233cb9-ac05-48ee-bd40-d19eb5255fd2 req-c2bec6d7-31c8-4b06-85b8-3b16c9d4b335 tempest-TestStampPattern-1275508992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:49:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-8c233cb9-ac05-48ee-bd40-d19eb5255fd2 req-c2bec6d7-31c8-4b06-85b8-3b16c9d4b335 tempest-TestStampPattern-1275508992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-788599f1-d9d2-45a4-b748-3679ccd47feb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18a948d4-08c6-409d-b3c4-4cd123aaa56b', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:49:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-8c233cb9-ac05-48ee-bd40-d19eb5255fd2 req-c2bec6d7-31c8-4b06-85b8-3b16c9d4b335 tempest-TestStampPattern-1275508992 None] attachment_update completed successfully. Sep 29 16:49:11 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-ade46fa8-3fc0-4d30-9ba5-742580337d36 req-2ebdb5e4-2b19-4f8f-99f6-9d411345d021 tempest-TestStampPattern-1275508992 None] Terminate volume connection completed successfully. Sep 29 16:49:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-ade46fa8-3fc0-4d30-9ba5-742580337d36 req-2ebdb5e4-2b19-4f8f-99f6-9d411345d021 tempest-TestStampPattern-1275508992 None] Deleting attachment 18a948d4-08c6-409d-b3c4-4cd123aaa56b. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:49:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:49:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:49:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] Creating offline snapshot 8642a2df-29a8-46f5-85bf-cb8036167f9b of volume 788599f1-d9d2-45a4-b748-3679ccd47feb {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:49:11 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3741e9b3-830d-4229-88a8-1e66f748170e]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:49:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:49:11 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb Sep 29 16:49:11 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:49:12 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Sep 29 16:49:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb" returned: 0 in 0.360s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:49:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:49:12 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b 1G Sep 29 16:49:12 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:49:12 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 29 16:49:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b 1G" returned: 0 in 0.388s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:49:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-788599f1-d9d2-45a4-b748-3679ccd47feb -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:49:12 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-788599f1-d9d2-45a4-b748-3679ccd47feb -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b Sep 29 16:49:12 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:49:12 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Sep 29 16:49:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-788599f1-d9d2-45a4-b748-3679ccd47feb -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b" returned: 0 in 0.289s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:49:12 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b is being set with open permissions: ugo+rw Sep 29 16:49:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:49:12 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b Sep 29 16:49:12 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:49:13 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 29 16:49:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b" returned: 0 in 0.265s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:49:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:49:13 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.info Sep 29 16:49:13 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:49:13 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Sep 29 16:49:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.info" returned: 0 in 0.248s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:49:13 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.info is being set with open permissions: ugo+rw Sep 29 16:49:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:49:13 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.info Sep 29 16:49:13 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:49:13 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Sep 29 16:49:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.info" returned: 0 in 0.256s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:49:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.892s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:49:13 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5618001b-7e4e-4d5a-8e2f-0298d549a0d2 tempest-TestStampPattern-1275508992 None] Create snapshot completed successfully Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Flow 'volume_create_manager' (cd140b1b-474b-4051-bc84-babba8a6837a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a296c4d1-3a4d-4719-8446-a8f98a275e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a296c4d1-3a4d-4719-8446-a8f98a275e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-398119597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7188781-916e-4ef9-b6ef-184ab71775b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d73e61dbfbd407f94e92773831a66b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8642a2df-29a8-46f5-85bf-cb8036167f9b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:49:20Z,use_quota=True,user_id='b1d34a566cf74c668f12d0b536f3f3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ba3693-55c5-4e6e-822d-e9fda52fe148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ba3693-55c5-4e6e-822d-e9fda52fe148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306b94f6-7676-4dcf-8c66-bec782e6e7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (306b94f6-7676-4dcf-8c66-bec782e6e7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e7188781-916e-4ef9-b6ef-184ab71775b0', 'volume_name': 'volume-e7188781-916e-4ef9-b6ef-184ab71775b0', 'volume_size': 1, 'snapshot_id': '8642a2df-29a8-46f5-85bf-cb8036167f9b'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609666d7-a3d2-418b-8ec6-9ae3adeb0d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609666d7-a3d2-418b-8ec6-9ae3adeb0d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b006e27a-cf1d-429f-86df-ffc2670461ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:49:20 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Volume e7188781-916e-4ef9-b6ef-184ab71775b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e7188781-916e-4ef9-b6ef-184ab71775b0', 'volume_size': 1, 'snapshot_id': '8642a2df-29a8-46f5-85bf-cb8036167f9b'} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Acquiring lock "cinder-quobyte-8642a2df-29a8-46f5-85bf-cb8036167f9b-e7188781-916e-4ef9-b6ef-184ab71775b0" by "_create_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Lock "cinder-quobyte-8642a2df-29a8-46f5-85bf-cb8036167f9b-e7188781-916e-4ef9-b6ef-184ab71775b0" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Creating volume e7188781-916e-4ef9-b6ef-184ab71775b0 from snapshot 8642a2df-29a8-46f5-85bf-cb8036167f9b {{(pid=86793) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Acquiring lock "cinder-quobyte-e7188781-916e-4ef9-b6ef-184ab71775b0" by "_copy_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Lock "cinder-quobyte-e7188781-916e-4ef9-b6ef-184ab71775b0" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] snapshot: 8642a2df-29a8-46f5-85bf-cb8036167f9b, volume: e7188781-916e-4ef9-b6ef-184ab71775b0, {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e39461-8fce-4687-b8c1-9c4b83f2cf49]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:49:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:49:20 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b Sep 29 16:49:20 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:49:21 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 29 16:49:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b" returned: 0 in 0.381s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:49:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-788599f1-d9d2-45a4-b748-3679ccd47feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:49:21 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2128ca-a557-466b-9605-64d073280f3a]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:49:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:49:21 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb Sep 29 16:49:21 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:49:21 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 29 16:49:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb" returned: 0 in 0.379s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:49:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] will copy from snapshot at /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 16:49:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Creating direct copy from snapshot {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 16:49:21 devstack cinder-volume[86793]: DEBUG cinder.utils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Path /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0 not found in is_blk_device check {{(pid=86793) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 16:49:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:49:21 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0 Sep 29 16:49:21 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:49:29 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Sep 29 16:49:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0" returned: 0 in 8.398s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:49:29 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb, size 1024.00 MB, duration 8.40 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:49:29 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Converted 1024.00 MB image at 121.92 MB/s Sep 29 16:49:29 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0 is being set with open permissions: ugo+rw Sep 29 16:49:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:49:29 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0 Sep 29 16:49:29 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:49:30 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 29 16:49:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0" returned: 0 in 0.323s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:49:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Lock "cinder-quobyte-e7188781-916e-4ef9-b6ef-184ab71775b0" released by "_copy_volume_from_snapshot" :: held 9.581s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:49:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Lock "cinder-quobyte-8642a2df-29a8-46f5-85bf-cb8036167f9b-e7188781-916e-4ef9-b6ef-184ab71775b0" released by "_create_volume_from_snapshot" :: held 9.657s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:49:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.674s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:49:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b006e27a-cf1d-429f-86df-ffc2670461ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7188781-916e-4ef9-b6ef-184ab71775b0', 'volume_size': 1, 'snapshot_id': '8642a2df-29a8-46f5-85bf-cb8036167f9b'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:49:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af07517e-08bb-49d2-aaa7-46ca4cf40837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:49:30 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Volume volume-e7188781-916e-4ef9-b6ef-184ab71775b0 (e7188781-916e-4ef9-b6ef-184ab71775b0): created successfully Sep 29 16:49:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af07517e-08bb-49d2-aaa7-46ca4cf40837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:49:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Flow 'volume_create_manager' (cd140b1b-474b-4051-bc84-babba8a6837a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:49:30 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2d12be38-fd25-4eec-807a-70ff2e72d4e7 tempest-TestStampPattern-1275508992 None] Created volume successfully. Sep 29 16:49:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:49:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:49:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:49:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:49:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:49:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:49:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:49:34 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:49:34 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:49:35 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Sep 29 16:49:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.264s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:49:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:49:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:49:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:49:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:49:40 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6,cinder:INSERT=2 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:49:40 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=15,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:50:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-1d04ef9e-e340-4e5e-b8f3-9fde279c37cf req-e1f4b3d8-84c7-4b97-9e9f-7eccc92c114a tempest-TestStampPattern-1275508992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-1d04ef9e-e340-4e5e-b8f3-9fde279c37cf req-e1f4b3d8-84c7-4b97-9e9f-7eccc92c114a tempest-TestStampPattern-1275508992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [req-1d04ef9e-e340-4e5e-b8f3-9fde279c37cf req-e1f4b3d8-84c7-4b97-9e9f-7eccc92c114a tempest-TestStampPattern-1275508992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-1d04ef9e-e340-4e5e-b8f3-9fde279c37cf req-e1f4b3d8-84c7-4b97-9e9f-7eccc92c114a tempest-TestStampPattern-1275508992 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb', 'name': 'volume-e7188781-916e-4ef9-b6ef-184ab71775b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b71a1b49-bdcd-475d-ac24-af60ca7ff4f0', 'enforce_multipath': True} {{(pid=86793) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 16:50:12 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-1d04ef9e-e340-4e5e-b8f3-9fde279c37cf req-e1f4b3d8-84c7-4b97-9e9f-7eccc92c114a tempest-TestStampPattern-1275508992 None] attachment_update completed successfully. Sep 29 16:50:15 devstack cinder-volume[86793]: INFO cinder.volume.manager [req-93a44cac-74a2-4839-a6f7-ed6d3632492c req-7c7eafe6-f61a-409f-8b30-f5ce171f8121 tempest-TestStampPattern-1275508992 None] Terminate volume connection completed successfully. Sep 29 16:50:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [req-93a44cac-74a2-4839-a6f7-ed6d3632492c req-7c7eafe6-f61a-409f-8b30-f5ce171f8121 tempest-TestStampPattern-1275508992 None] Deleting attachment b71a1b49-bdcd-475d-ac24-af60ca7ff4f0. {{(pid=86793) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 16:50:19 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Acquiring lock "cinder-e7188781-916e-4ef9-b6ef-184ab71775b0-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:19 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Lock "cinder-e7188781-916e-4ef9-b6ef-184ab71775b0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:19 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Acquiring lock "cinder-quobyte-e7188781-916e-4ef9-b6ef-184ab71775b0" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:19 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Lock "cinder-quobyte-e7188781-916e-4ef9-b6ef-184ab71775b0" acquired by "delete_volume" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:19 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5677ce-9ba7-4c3e-a518-7d46d2192360]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:50:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:19 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0 Sep 29 16:50:19 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:19 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0" returned: 0 in 0.358s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:19 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0 Sep 29 16:50:19 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:20 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e7188781-916e-4ef9-b6ef-184ab71775b0" returned: 0 in 0.240s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Lock "cinder-quobyte-e7188781-916e-4ef9-b6ef-184ab71775b0" released by "delete_volume" :: held 0.638s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Created reservations ['52af34d8-0476-4bc0-a238-7173bffed741', 'a080fd53-d277-442f-9b36-61c82816f7f4', '442d1ba2-adce-4ad3-b679-6558c7e1b556', 'd9c87c1c-343a-440f-b420-4f313b854b06'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:20 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:50:20 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:20 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.233s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:50:20 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Deleted volume successfully. Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-444f58de-e44b-48f7-a9b6-9016e1d9ebb2 tempest-TestStampPattern-1275508992 None] Lock "cinder-e7188781-916e-4ef9-b6ef-184ab71775b0-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Acquiring lock "cinder-8642a2df-29a8-46f5-85bf-cb8036167f9b-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Lock "cinder-8642a2df-29a8-46f5-85bf-cb8036167f9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Acquiring lock "cinder-quobyte-788599f1-d9d2-45a4-b748-3679ccd47feb" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Lock "cinder-quobyte-788599f1-d9d2-45a4-b748-3679ccd47feb" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Acquiring lock "cinder-quobyte-8642a2df-29a8-46f5-85bf-cb8036167f9b" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Lock "cinder-quobyte-8642a2df-29a8-46f5-85bf-cb8036167f9b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Deleting offline snapshot 8642a2df-29a8-46f5-85bf-cb8036167f9b of volume 788599f1-d9d2-45a4-b748-3679ccd47feb {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] snapshot_file for this snap is: volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bd60bb-dcc5-4e64-9bd6-9b6c7679e06d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:50:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:21 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b Sep 29 16:50:21 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:21 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b" returned: 0 in 0.362s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-788599f1-d9d2-45a4-b748-3679ccd47feb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:50:21 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db86c0d-4ee4-4736-8a32-c35ee4b334ee]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:50:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:21 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb Sep 29 16:50:21 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:21 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb" returned: 0 in 0.525s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:21 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b Sep 29 16:50:21 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:22 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b" returned: 0 in 0.327s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:22 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b Sep 29 16:50:22 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:22 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb.8642a2df-29a8-46f5-85bf-cb8036167f9b" returned: 0 in 0.249s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:22 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Lock "cinder-quobyte-8642a2df-29a8-46f5-85bf-cb8036167f9b" released by "_delete_snapshot" :: held 1.562s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:22 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Lock "cinder-quobyte-788599f1-d9d2-45a4-b748-3679ccd47feb" released by "delete_snapshot" :: held 1.584s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:22 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Created reservations ['c1fca504-7987-411f-8a21-e7816b120f0b', '563c1f69-7c2a-4143-a61e-c4a827813d7b', '8e2a2a26-4d32-45c1-9450-4d10b44e3e69', 'dd03dd9a-d7a3-45fa-a103-b8f953e31f7c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:50:22 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Delete snapshot completed successfully. Sep 29 16:50:22 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5d37f989-9fab-49ee-847c-e029472c1a12 tempest-TestStampPattern-1275508992 None] Lock "cinder-8642a2df-29a8-46f5-85bf-cb8036167f9b-delete_snapshot" released by "delete_snapshot" :: held 1.705s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Acquiring lock "cinder-788599f1-d9d2-45a4-b748-3679ccd47feb-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Lock "cinder-788599f1-d9d2-45a4-b748-3679ccd47feb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Acquiring lock "cinder-quobyte-788599f1-d9d2-45a4-b748-3679ccd47feb" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Lock "cinder-quobyte-788599f1-d9d2-45a4-b748-3679ccd47feb" acquired by "delete_volume" :: waited 0.013s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:26 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bcb697-4de5-478f-8d40-db2a7dd48187]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:50:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:26 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb Sep 29 16:50:26 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:26 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb" returned: 0 in 0.347s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:27 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb Sep 29 16:50:27 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:27 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-788599f1-d9d2-45a4-b748-3679ccd47feb" returned: 0 in 0.239s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Lock "cinder-quobyte-788599f1-d9d2-45a4-b748-3679ccd47feb" released by "delete_volume" :: held 0.645s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:27 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Created reservations ['5f287c96-bf58-48a1-b5a0-eadba0cf8275', 'f00d674e-95a2-4f8c-b34a-c6ca836d39c8', 'eff2f4c8-3bbe-49fa-b8eb-fe875753bddc', '1c7939f4-ee2c-497d-b214-05e0b799acf1'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:50:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:50:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:50:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:27 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:50:27 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:27 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.239s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:27 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:50:27 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Deleted volume successfully. Sep 29 16:50:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f8fa3db2-9a6b-4ea7-9f5c-a60af0df926f tempest-TestStampPattern-1275508992 None] Lock "cinder-788599f1-d9d2-45a4-b748-3679ccd47feb-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:50:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:50:34 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:50:37 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=22,cinder:UPDATE=23,cinder:INSERT=8 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:50:37 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=25,cinder:UPDATE=24,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Flow 'volume_create_manager' (13f51289-8f21-47a6-a4fb-4f969f3335ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a555562c-c7e4-4254-a006-473a7e247925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a555562c-c7e4-4254-a006-473a7e247925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120518478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c20d58f-256d-45dc-8b1e-7c726a8953c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b6479651b642ffaba47b8759c1f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:39Z,use_quota=True,user_id='c2bcb7e4bd2749eebfbf26dbb8f17d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cccdf041-8c14-464c-97d2-38cab6f3188f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cccdf041-8c14-464c-97d2-38cab6f3188f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a894b573-1efd-45e5-a928-4c6e1f96bf0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a894b573-1efd-45e5-a928-4c6e1f96bf0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c20d58f-256d-45dc-8b1e-7c726a8953c2', 'volume_name': 'volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3390b05-95f8-4c21-bd16-53b695790503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3390b05-95f8-4c21-bd16-53b695790503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8bcb8d-0f9c-452a-8f7c-9a596efdfbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:39 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume 7c20d58f-256d-45dc-8b1e-7c726a8953c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2', 'volume_size': 1} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120518478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c20d58f-256d-45dc-8b1e-7c726a8953c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b6479651b642ffaba47b8759c1f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:39Z,use_quota=True,user_id='c2bcb7e4bd2749eebfbf26dbb8f17d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Creating volume 7c20d58f-256d-45dc-8b1e-7c726a8953c2 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:50:39 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:39 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 1073741824 Sep 29 16:50:39 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:39 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 1073741824" returned: 0 in 0.416s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:39 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 Sep 29 16:50:39 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:39 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2" returned: 0 in 0.245s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab8bcb8d-0f9c-452a-8f7c-9a596efdfbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1885a7d-5a4d-44a5-8ff8-5b1bb0dbaeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:39 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 (7c20d58f-256d-45dc-8b1e-7c726a8953c2): created successfully Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1885a7d-5a4d-44a5-8ff8-5b1bb0dbaeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Flow 'volume_create_manager' (13f51289-8f21-47a6-a4fb-4f969f3335ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:50:39 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-0deb20ac-6388-4041-80f4-bbb6af536e87 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Created volume successfully. Sep 29 16:50:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:40 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Creating offline snapshot 2876a5bb-095b-4550-be56-43e7b4e4cfb3 of volume 7c20d58f-256d-45dc-8b1e-7c726a8953c2 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:50:40 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[772db148-59ef-40aa-9a70-485016d2eeae]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:50:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:40 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 Sep 29 16:50:40 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:40 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2" returned: 0 in 0.355s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:40 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 1G Sep 29 16:50:40 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:40 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 1G" returned: 0 in 0.395s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:40 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 Sep 29 16:50:40 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:41 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3" returned: 0 in 0.284s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:41 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 is being set with open permissions: ugo+rw Sep 29 16:50:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:41 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 Sep 29 16:50:41 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:41 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3" returned: 0 in 0.239s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:41 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.info Sep 29 16:50:41 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:41 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.info" returned: 0 in 0.256s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:41 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.info is being set with open permissions: ugo+rw Sep 29 16:50:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:41 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.info Sep 29 16:50:41 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:42 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.info" returned: 0 in 0.240s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:42 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ea437124-eb26-4bcd-851e-8b83149a0188 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Create snapshot completed successfully Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Flow 'volume_create_manager' (03107d87-ff74-4684-ad26-44ec1bcb44c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb9ba8f-37b3-4150-a245-e1ddc1943ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb9ba8f-37b3-4150-a245-e1ddc1943ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1396621201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4320dc8-653b-48c4-8368-4ed96931c189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b6479651b642ffaba47b8759c1f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:43Z,use_quota=True,user_id='c2bcb7e4bd2749eebfbf26dbb8f17d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa97f89-0cae-4e88-93a5-ae2aa8dea33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa97f89-0cae-4e88-93a5-ae2aa8dea33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f387fca-b350-49ba-bc0c-823b99e155e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f387fca-b350-49ba-bc0c-823b99e155e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4320dc8-653b-48c4-8368-4ed96931c189', 'volume_name': 'volume-d4320dc8-653b-48c4-8368-4ed96931c189', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0384c848-95c4-47ea-a9fd-4f58c3fd9499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0384c848-95c4-47ea-a9fd-4f58c3fd9499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51f14f4-c439-4772-9c40-6adb538220aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:42 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume d4320dc8-653b-48c4-8368-4ed96931c189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4320dc8-653b-48c4-8368-4ed96931c189', 'volume_size': 1} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1396621201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4320dc8-653b-48c4-8368-4ed96931c189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b6479651b642ffaba47b8759c1f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:43Z,use_quota=True,user_id='c2bcb7e4bd2749eebfbf26dbb8f17d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Creating volume d4320dc8-653b-48c4-8368-4ed96931c189 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:50:42 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:50:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d4320dc8-653b-48c4-8368-4ed96931c189 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:42 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d4320dc8-653b-48c4-8368-4ed96931c189 1073741824 Sep 29 16:50:42 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Flow 'volume_create_manager' (1ed3facc-0ce2-4f57-8db3-9d29577ec6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c19d20f-a644-46f0-8e74-f83653cd7101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c19d20f-a644-46f0-8e74-f83653cd7101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-942697849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3dd26c1-1ebf-49fa-b233-9e4b309d23b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b6479651b642ffaba47b8759c1f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:43Z,use_quota=True,user_id='c2bcb7e4bd2749eebfbf26dbb8f17d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fda8e0-ef30-4130-b7bf-ee43d30c0c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97fda8e0-ef30-4130-b7bf-ee43d30c0c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef215416-a82c-41a2-b6f4-e63ccdcc0c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef215416-a82c-41a2-b6f4-e63ccdcc0c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3dd26c1-1ebf-49fa-b233-9e4b309d23b1', 'volume_name': 'volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f57bd09-730e-4023-99a1-be5c5a49b151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f57bd09-730e-4023-99a1-be5c5a49b151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1041306-5f38-474a-984d-d73e07ba02e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume b3dd26c1-1ebf-49fa-b233-9e4b309d23b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1', 'volume_size': 1} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:43 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d4320dc8-653b-48c4-8368-4ed96931c189 1073741824" returned: 0 in 0.485s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d4320dc8-653b-48c4-8368-4ed96931c189 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:43 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d4320dc8-653b-48c4-8368-4ed96931c189 Sep 29 16:50:43 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Flow 'volume_create_manager' (d934051e-2061-4450-a75c-44eb05462bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b43c13a-86ec-45d0-891d-718827851ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b43c13a-86ec-45d0-891d-718827851ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-661015511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c9d87c-f3f2-42b0-9964-8ad72ebcad29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b6479651b642ffaba47b8759c1f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:43Z,use_quota=True,user_id='c2bcb7e4bd2749eebfbf26dbb8f17d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0f5e19-a2b1-4cb5-ab89-50055b45826e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0f5e19-a2b1-4cb5-ab89-50055b45826e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa95303-0773-4147-b069-1e68887099d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aa95303-0773-4147-b069-1e68887099d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c9d87c-f3f2-42b0-9964-8ad72ebcad29', 'volume_name': 'volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b941c21-ad2d-4249-b148-99ffe1bb9a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b941c21-ad2d-4249-b148-99ffe1bb9a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdfbcbf-a5b7-44e0-86e0-960002bec2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume 19c9d87c-f3f2-42b0-9964-8ad72ebcad29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29', 'volume_size': 1} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:43 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d4320dc8-653b-48c4-8368-4ed96931c189" returned: 0 in 0.285s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-942697849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3dd26c1-1ebf-49fa-b233-9e4b309d23b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b6479651b642ffaba47b8759c1f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:43Z,use_quota=True,user_id='c2bcb7e4bd2749eebfbf26dbb8f17d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Creating volume b3dd26c1-1ebf-49fa-b233-9e4b309d23b1 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:50:43 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51f14f4-c439-4772-9c40-6adb538220aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4320dc8-653b-48c4-8368-4ed96931c189', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:43 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1 1073741824 Sep 29 16:50:43 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18cafb90-3e92-4d4e-92ba-6632c0b00b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume volume-d4320dc8-653b-48c4-8368-4ed96931c189 (d4320dc8-653b-48c4-8368-4ed96931c189): created successfully Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18cafb90-3e92-4d4e-92ba-6632c0b00b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Flow 'volume_create_manager' (03107d87-ff74-4684-ad26-44ec1bcb44c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:50:43 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-6f63e8a1-d72e-40a2-afb2-432277a28cb5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Created volume successfully. Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Flow 'volume_create_manager' (8b1ae7a9-babb-4111-9ab0-26aaaddbb590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2726e97e-285f-4779-8e0c-37ab1900a5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2726e97e-285f-4779-8e0c-37ab1900a5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-669774502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1185532c-fc26-4525-871d-8e5460f2ce8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b6479651b642ffaba47b8759c1f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:44Z,use_quota=True,user_id='c2bcb7e4bd2749eebfbf26dbb8f17d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36205ef2-49a3-4061-ba32-b6f2f528f09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36205ef2-49a3-4061-ba32-b6f2f528f09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebf8272-5fd6-4b63-8e07-ef11d7050541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ebf8272-5fd6-4b63-8e07-ef11d7050541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1185532c-fc26-4525-871d-8e5460f2ce8e', 'volume_name': 'volume-1185532c-fc26-4525-871d-8e5460f2ce8e', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3ab738-d45d-4baf-b492-b6e99c46a3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3ab738-d45d-4baf-b492-b6e99c46a3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4415c723-57bd-417a-aae2-c999fbcac235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:43 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume 1185532c-fc26-4525-871d-8e5460f2ce8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1185532c-fc26-4525-871d-8e5460f2ce8e', 'volume_size': 1} Sep 29 16:50:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:44 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1 1073741824" returned: 0 in 0.514s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Flow 'volume_create_manager' (8b4b609a-c3aa-4347-be9c-cf1fc98414c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712a2b90-1ee9-4c9d-9c24-81481cf5e482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712a2b90-1ee9-4c9d-9c24-81481cf5e482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1602819416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2292fcb-96d1-434d-abc8-d1ead0fc98cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b6479651b642ffaba47b8759c1f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:44Z,use_quota=True,user_id='c2bcb7e4bd2749eebfbf26dbb8f17d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc051fa-7d9c-4d80-8b6b-e1f6504b8e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc051fa-7d9c-4d80-8b6b-e1f6504b8e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ad7407-faeb-44aa-bce2-1bc5d68f237c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ad7407-faeb-44aa-bce2-1bc5d68f237c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2292fcb-96d1-434d-abc8-d1ead0fc98cb', 'volume_name': 'volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6838bc62-4ffd-49a9-a7af-501f2dc7162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6838bc62-4ffd-49a9-a7af-501f2dc7162e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9025c7-a9c1-41b7-b449-a6125bd1fede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:44 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume c2292fcb-96d1-434d-abc8-d1ead0fc98cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb', 'volume_size': 1} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:44 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1 Sep 29 16:50:44 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:44 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1" returned: 0 in 0.244s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.994s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-661015511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c9d87c-f3f2-42b0-9964-8ad72ebcad29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b6479651b642ffaba47b8759c1f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:43Z,use_quota=True,user_id='c2bcb7e4bd2749eebfbf26dbb8f17d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Creating volume 19c9d87c-f3f2-42b0-9964-8ad72ebcad29 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:50:44 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:44 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29 1073741824 Sep 29 16:50:44 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1041306-5f38-474a-984d-d73e07ba02e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1365e059-016e-46d2-8bde-3e23604a7178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:44 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1 (b3dd26c1-1ebf-49fa-b233-9e4b309d23b1): created successfully Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1365e059-016e-46d2-8bde-3e23604a7178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Flow 'volume_create_manager' (1ed3facc-0ce2-4f57-8db3-9d29577ec6a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:50:44 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-786ea7de-cadf-49fc-afd7-8ac916fc6149 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Created volume successfully. Sep 29 16:50:44 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29 1073741824" returned: 0 in 0.446s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:45 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29 Sep 29 16:50:45 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:45 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29" returned: 0 in 0.243s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.367s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-669774502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1185532c-fc26-4525-871d-8e5460f2ce8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b6479651b642ffaba47b8759c1f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:44Z,use_quota=True,user_id='c2bcb7e4bd2749eebfbf26dbb8f17d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Creating volume 1185532c-fc26-4525-871d-8e5460f2ce8e {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:50:45 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1185532c-fc26-4525-871d-8e5460f2ce8e 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fdfbcbf-a5b7-44e0-86e0-960002bec2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:45 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1185532c-fc26-4525-871d-8e5460f2ce8e 1073741824 Sep 29 16:50:45 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fe4367-0913-4c37-bc6c-c47e2b9e8e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:45 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29 (19c9d87c-f3f2-42b0-9964-8ad72ebcad29): created successfully Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fe4367-0913-4c37-bc6c-c47e2b9e8e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Flow 'volume_create_manager' (d934051e-2061-4450-a75c-44eb05462bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:50:45 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b82952e3-4b59-4cb8-ab76-584ac3a918bd tempest-CreateVolumesFromSnapshotTest-1386555719 None] Created volume successfully. Sep 29 16:50:45 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1185532c-fc26-4525-871d-8e5460f2ce8e 1073741824" returned: 0 in 0.407s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1185532c-fc26-4525-871d-8e5460f2ce8e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:45 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1185532c-fc26-4525-871d-8e5460f2ce8e Sep 29 16:50:45 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:45 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1185532c-fc26-4525-871d-8e5460f2ce8e" returned: 0 in 0.246s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.683s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1602819416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2292fcb-96d1-434d-abc8-d1ead0fc98cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85b6479651b642ffaba47b8759c1f722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:50:44Z,use_quota=True,user_id='c2bcb7e4bd2749eebfbf26dbb8f17d2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Creating volume c2292fcb-96d1-434d-abc8-d1ead0fc98cb {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:50:45 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4415c723-57bd-417a-aae2-c999fbcac235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1185532c-fc26-4525-871d-8e5460f2ce8e', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:45 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb 1073741824 Sep 29 16:50:45 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ed6c38-3586-4d12-b99f-24b192114c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:45 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume volume-1185532c-fc26-4525-871d-8e5460f2ce8e (1185532c-fc26-4525-871d-8e5460f2ce8e): created successfully Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1ed6c38-3586-4d12-b99f-24b192114c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Flow 'volume_create_manager' (8b1ae7a9-babb-4111-9ab0-26aaaddbb590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:50:45 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2c513cd2-1ffc-432b-b057-7593ab297e74 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Created volume successfully. Sep 29 16:50:46 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb 1073741824" returned: 0 in 0.439s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:46 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb Sep 29 16:50:46 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:46 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb" returned: 0 in 0.243s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:50:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9025c7-a9c1-41b7-b449-a6125bd1fede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bdb7c3-21ec-43fa-905d-85b374877dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:50:46 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Volume volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb (c2292fcb-96d1-434d-abc8-d1ead0fc98cb): created successfully Sep 29 16:50:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8bdb7c3-21ec-43fa-905d-85b374877dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:50:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Flow 'volume_create_manager' (8b4b609a-c3aa-4347-be9c-cf1fc98414c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:50:46 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-aed29cb0-3070-419f-92dd-025b178a8dc2 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Created volume successfully. Sep 29 16:50:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-c2292fcb-96d1-434d-abc8-d1ead0fc98cb-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-c2292fcb-96d1-434d-abc8-d1ead0fc98cb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-quobyte-c2292fcb-96d1-434d-abc8-d1ead0fc98cb" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-c2292fcb-96d1-434d-abc8-d1ead0fc98cb" acquired by "delete_volume" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:47 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[064ae506-1d0a-4174-a180-8e7c04e25993]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:50:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:47 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb Sep 29 16:50:47 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:47 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb" returned: 0 in 0.350s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:47 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb Sep 29 16:50:47 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:48 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c2292fcb-96d1-434d-abc8-d1ead0fc98cb" returned: 0 in 0.240s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-c2292fcb-96d1-434d-abc8-d1ead0fc98cb" released by "delete_volume" :: held 0.631s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Created reservations ['5d160d13-ae6d-4d78-a648-5f7a38dff741', '5c26b82b-8a63-4c17-9a08-fe91308a4937', '260b5298-ef6f-4da6-8920-fec4f0c473a8', '3ef60d0e-d1b9-4fb0-97f5-05e282969578'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:48 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:50:48 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:48 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.238s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:50:48 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Deleted volume successfully. Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-da3c5e3f-502b-4798-a49e-6aff901f2c06 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-c2292fcb-96d1-434d-abc8-d1ead0fc98cb-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-1185532c-fc26-4525-871d-8e5460f2ce8e-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-1185532c-fc26-4525-871d-8e5460f2ce8e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-quobyte-1185532c-fc26-4525-871d-8e5460f2ce8e" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-1185532c-fc26-4525-871d-8e5460f2ce8e" acquired by "delete_volume" :: waited 0.013s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b9bc78-b402-4e82-9755-2b731b5e9d06]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:50:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1185532c-fc26-4525-871d-8e5460f2ce8e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:48 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1185532c-fc26-4525-871d-8e5460f2ce8e Sep 29 16:50:48 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:49 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1185532c-fc26-4525-871d-8e5460f2ce8e" returned: 0 in 0.354s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1185532c-fc26-4525-871d-8e5460f2ce8e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:49 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1185532c-fc26-4525-871d-8e5460f2ce8e Sep 29 16:50:49 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:49 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-1185532c-fc26-4525-871d-8e5460f2ce8e" returned: 0 in 0.247s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-1185532c-fc26-4525-871d-8e5460f2ce8e" released by "delete_volume" :: held 0.643s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Created reservations ['8c72946a-ccdd-475d-8bb6-94178010c2e9', '8e7901a4-e826-4798-8984-94ac834f2e16', '64534f7a-c462-4ad3-a378-ede2aec3e37c', '37fb3836-4006-4c49-8ee5-85c573a6e127'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:49 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:50:49 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:49 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.249s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:50:49 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Deleted volume successfully. Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f544bdf4-c717-4f65-91fd-009ac65475f5 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-1185532c-fc26-4525-871d-8e5460f2ce8e-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-19c9d87c-f3f2-42b0-9964-8ad72ebcad29-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-19c9d87c-f3f2-42b0-9964-8ad72ebcad29-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-quobyte-19c9d87c-f3f2-42b0-9964-8ad72ebcad29" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-19c9d87c-f3f2-42b0-9964-8ad72ebcad29" acquired by "delete_volume" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e385e9-8620-4aa3-a8b9-a8b4fb369919]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:50:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:50 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29 Sep 29 16:50:50 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:50 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29" returned: 0 in 0.357s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:50 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29 Sep 29 16:50:50 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:50 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-19c9d87c-f3f2-42b0-9964-8ad72ebcad29" returned: 0 in 0.251s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-19c9d87c-f3f2-42b0-9964-8ad72ebcad29" released by "delete_volume" :: held 0.647s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Created reservations ['06866f94-7b1c-49e9-b990-83ecfc456b34', 'ad355c22-a9d5-4b3c-9454-e74684fe0bcd', '343a3979-ce62-451d-b798-2950c472b468', '6a884792-697a-454f-8536-97e8a179982c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:50 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:50:50 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:50 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.237s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:50:50 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Deleted volume successfully. Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a94071c1-66b7-4d2f-a720-69f7ed2d68b6 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-19c9d87c-f3f2-42b0-9964-8ad72ebcad29-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-quobyte-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f8f1f0-ccbf-44c1-896e-d0553d4a8126]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:51 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1 Sep 29 16:50:51 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:51 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1" returned: 0 in 0.362s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:51 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1 Sep 29 16:50:51 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:51 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1" returned: 0 in 0.242s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1" released by "delete_volume" :: held 0.646s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Created reservations ['a3a36871-e682-456a-a953-f2419357c958', '12adcaf3-6dd7-47e9-8a6b-efadda329b4b', '20ddec13-7269-4d06-b80a-57b8db527c2c', 'aec80532-3cfe-4200-8df4-4cea289de429'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:51 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:50:51 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:52 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.241s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:50:52 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Deleted volume successfully. Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-85f68b70-bdf8-494d-8b86-3d4c47f6a430 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-b3dd26c1-1ebf-49fa-b233-9e4b309d23b1-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-d4320dc8-653b-48c4-8368-4ed96931c189-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-d4320dc8-653b-48c4-8368-4ed96931c189-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-quobyte-d4320dc8-653b-48c4-8368-4ed96931c189" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-d4320dc8-653b-48c4-8368-4ed96931c189" acquired by "delete_volume" :: waited 0.013s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b804e45-0c28-4f23-a062-46456e8c8a43]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d4320dc8-653b-48c4-8368-4ed96931c189 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:52 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d4320dc8-653b-48c4-8368-4ed96931c189 Sep 29 16:50:52 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:52 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d4320dc8-653b-48c4-8368-4ed96931c189" returned: 0 in 0.353s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d4320dc8-653b-48c4-8368-4ed96931c189 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:52 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d4320dc8-653b-48c4-8368-4ed96931c189 Sep 29 16:50:52 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:52 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d4320dc8-653b-48c4-8368-4ed96931c189" returned: 0 in 0.238s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-d4320dc8-653b-48c4-8368-4ed96931c189" released by "delete_volume" :: held 0.628s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Created reservations ['9563bb6d-9188-4663-9010-46fc0dbb2bfe', '2f43db4e-982c-4f5e-a6df-cd82e583a1f2', '45785454-b355-4c4e-a8ca-e8feea539895', 'd6cb13af-7f69-425e-b654-a09f8a908c0c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:52 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:50:52 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:53 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.231s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:50:53 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Deleted volume successfully. Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-84025bbc-09c0-421a-8bfc-ed6eaefe140e tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-d4320dc8-653b-48c4-8368-4ed96931c189-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-2876a5bb-095b-4550-be56-43e7b4e4cfb3-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-2876a5bb-095b-4550-be56-43e7b4e4cfb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-quobyte-7c20d58f-256d-45dc-8b1e-7c726a8953c2" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-7c20d58f-256d-45dc-8b1e-7c726a8953c2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-quobyte-2876a5bb-095b-4550-be56-43e7b4e4cfb3" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-2876a5bb-095b-4550-be56-43e7b4e4cfb3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Deleting offline snapshot 2876a5bb-095b-4550-be56-43e7b4e4cfb3 of volume 7c20d58f-256d-45dc-8b1e-7c726a8953c2 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] snapshot_file for this snap is: volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff3c6a2-c7cc-4f6a-bf88-1d97282df861]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:53 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 Sep 29 16:50:53 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:53 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3" returned: 0 in 0.343s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ec2ea9-af67-427b-a5b9-b83b8f702540]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:50:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:53 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 Sep 29 16:50:53 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:54 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2" returned: 0 in 0.361s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:54 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 Sep 29 16:50:54 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:54 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3" returned: 0 in 0.331s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:54 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3 Sep 29 16:50:54 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:54 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2.2876a5bb-095b-4550-be56-43e7b4e4cfb3" returned: 0 in 0.238s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-2876a5bb-095b-4550-be56-43e7b4e4cfb3" released by "_delete_snapshot" :: held 1.379s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-7c20d58f-256d-45dc-8b1e-7c726a8953c2" released by "delete_snapshot" :: held 1.404s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:54 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Created reservations ['5210e0f2-5cad-4953-ac9c-273172c09f6b', '7452472d-9ee2-41a6-b257-741797450e35', 'a8dc792e-1b91-4f62-b7eb-2465280d21aa', 'a58b452a-5e74-465d-9241-aeb9d040e30a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:50:54 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Delete snapshot completed successfully. Sep 29 16:50:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c8181efc-d8e4-4896-a5ed-c7ccbe678151 tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-2876a5bb-095b-4550-be56-43e7b4e4cfb3-delete_snapshot" released by "delete_snapshot" :: held 1.522s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-7c20d58f-256d-45dc-8b1e-7c726a8953c2-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-7c20d58f-256d-45dc-8b1e-7c726a8953c2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "cinder-quobyte-7c20d58f-256d-45dc-8b1e-7c726a8953c2" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:50:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-7c20d58f-256d-45dc-8b1e-7c726a8953c2" acquired by "delete_volume" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:50:55 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[954d717e-ed36-433e-a626-3d1923612253]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:50:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:55 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 Sep 29 16:50:55 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:55 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2" returned: 0 in 0.343s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:55 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2 Sep 29 16:50:55 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:56 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-7c20d58f-256d-45dc-8b1e-7c726a8953c2" returned: 0 in 0.250s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-quobyte-7c20d58f-256d-45dc-8b1e-7c726a8953c2" released by "delete_volume" :: held 0.649s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:50:56 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Created reservations ['40a73263-0ff7-4e16-8b56-030f3190431e', 'f560dad7-f16f-4a77-bc44-da5ac2c5c1f8', '5463fbe8-5515-4234-bb66-86dc8072ac5f', '7cda395a-aec3-44fc-b30b-c8178bde5efa'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:50:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:50:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:50:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:50:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:50:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:50:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:50:56 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:50:56 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:50:56 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Sep 29 16:50:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.246s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:50:56 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:50:56 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Deleted volume successfully. Sep 29 16:50:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-22a58b1f-e43b-4b5a-8adc-fdfcc054ddfa tempest-CreateVolumesFromSnapshotTest-1386555719 None] Lock "cinder-7c20d58f-256d-45dc-8b1e-7c726a8953c2-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Flow 'volume_create_manager' (c73c2556-11b0-4a58-91ae-73252ea9b624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa9e135-edba-49d0-a278-1419e496da61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa9e135-edba-49d0-a278-1419e496da61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e87b384-cac7-4564-919c-1b0ff6518716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b45958cfdc49eb856276d7a2339221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:01Z,use_quota=True,user_id='9441c66c7e4941bfa856d2211f03be5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70106eb-2011-4da2-a9de-a0b0f501a75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70106eb-2011-4da2-a9de-a0b0f501a75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56e6985-ce91-49b9-b887-43dba4c22d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG cinder.image.glance [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Creating Keystone auth plugin from conf {{(pid=86793) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56e6985-ce91-49b9-b887-43dba4c22d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e87b384-cac7-4564-919c-1b0ff6518716', 'volume_name': 'volume-3e87b384-cac7-4564-919c-1b0ff6518716', 'volume_size': 1, 'image_id': '6c1a0936-5c7c-44ea-886d-7a29d46eccb7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c1a0936-5c7c-44ea-886d-7a29d46eccb7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b8863e62bfd5510e32a60cceae9e081', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34b45958cfdc49eb856276d7a2339221', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '387d08e39f00c99486dd0a48f94e03267c066e4c29a74a24c1380d9d710175554b9ca266762eaa9b22226a8c4fb3188933a40053fc48e3234172242061638d66', 'id': '6c1a0936-5c7c-44ea-886d-7a29d46eccb7', 'created_at': datetime.datetime(2026, 9, 29, 14, 50, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c1a0936-5c7c-44ea-886d-7a29d46eccb7/file', 'properties': {}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0b4a41-613c-463f-bbbb-43c68cc07e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa0b4a41-613c-463f-bbbb-43c68cc07e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c416a44-3b86-48f6-bc6f-957c9246e7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:01 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Volume 3e87b384-cac7-4564-919c-1b0ff6518716: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e87b384-cac7-4564-919c-1b0ff6518716', 'volume_size': 1, 'image_id': '6c1a0936-5c7c-44ea-886d-7a29d46eccb7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c1a0936-5c7c-44ea-886d-7a29d46eccb7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b8863e62bfd5510e32a60cceae9e081', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34b45958cfdc49eb856276d7a2339221', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '387d08e39f00c99486dd0a48f94e03267c066e4c29a74a24c1380d9d710175554b9ca266762eaa9b22226a8c4fb3188933a40053fc48e3234172242061638d66', 'id': '6c1a0936-5c7c-44ea-886d-7a29d46eccb7', 'created_at': datetime.datetime(2026, 9, 29, 14, 50, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c1a0936-5c7c-44ea-886d-7a29d46eccb7/file', 'properties': {}}, 'image_service': } Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Trying to clone 3e87b384-cac7-4564-919c-1b0ff6518716 from image 6c1a0936-5c7c-44ea-886d-7a29d46eccb7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c1a0936-5c7c-44ea-886d-7a29d46eccb7', 'metadata': {}}]). {{(pid=86793) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 16:51:01 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Image download 0.00 MB at 0.00 MB/s Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba307b89-d5af-4790-8d67-5eb65f28a443]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:01 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD Sep 29 16:51:01 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:02 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:02 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD Sep 29 16:51:02 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:02 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:51:02 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Temporary image 6c1a0936-5c7c-44ea-886d-7a29d46eccb7 is fetched for user 9441c66c7e4941bfa856d2211f03be5f. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 16:51:02 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ef2e49-758d-4ca7-ab00-e5f12a8b6b23]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:02 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD Sep 29 16:51:02 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:02 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:02 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD Sep 29 16:51:02 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:03 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD" returned: 1 in 0.311s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e87b384-cac7-4564-919c-1b0ff6518716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34b45958cfdc49eb856276d7a2339221',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:01Z,use_quota=True,user_id='9441c66c7e4941bfa856d2211f03be5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Creating volume 3e87b384-cac7-4564-919c-1b0ff6518716 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:03 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:03 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 1073741824 Sep 29 16:51:03 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:03 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 1073741824" returned: 0 in 0.403s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:03 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 Sep 29 16:51:03 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:03 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716" returned: 0 in 0.247s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Attempting download of 6c1a0936-5c7c-44ea-886d-7a29d46eccb7 ((None, [{'url': 'file:///opt/stack/data/glance/images/6c1a0936-5c7c-44ea-886d-7a29d46eccb7', 'metadata': {}}])) to volume 3e87b384-cac7-4564-919c-1b0ff6518716. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[136cebe0-2d8b-41e9-b2c5-0f5990c639d4]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_iahst3h8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:03 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_iahst3h8 Sep 29 16:51:03 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:04 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_iahst3h8" returned: 0 in 0.319s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_iahst3h8 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:04 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_iahst3h8 Sep 29 16:51:04 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:04 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_iahst3h8" returned: 1 in 0.325s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_iahst3h8' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:51:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6829eb-713a-42bf-b090-99dacf5c5ef7]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:04 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD Sep 29 16:51:04 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:04 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:04 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD Sep 29 16:51:04 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:05 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD" returned: 1 in 0.309s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] 6c1a0936-5c7c-44ea-886d-7a29d46eccb7 was raw, converting to qcow2 {{(pid=86793) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:05 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 Sep 29 16:51:05 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:05 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716" returned: 0 in 0.418s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c1a0936-5c7c-44ea-886d-7a29d46eccb7_tntsudsudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:51:05 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:05 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 1G Sep 29 16:51:05 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:05 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 1G" returned: 0 in 0.303s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Downloaded image 6c1a0936-5c7c-44ea-886d-7a29d46eccb7 ((None, [{'url': 'file:///opt/stack/data/glance/images/6c1a0936-5c7c-44ea-886d-7a29d46eccb7', 'metadata': {}}])) to volume 3e87b384-cac7-4564-919c-1b0ff6518716 successfully. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Temporary image 6c1a0936-5c7c-44ea-886d-7a29d46eccb7 for user 9441c66c7e4941bfa856d2211f03be5f is deleted. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Marking volume 3e87b384-cac7-4564-919c-1b0ff6518716 as bootable. {{(pid=86793) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Copying metadata from image 6c1a0936-5c7c-44ea-886d-7a29d46eccb7 to 3e87b384-cac7-4564-919c-1b0ff6518716. {{(pid=86793) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Creating volume glance metadata for volume 3e87b384-cac7-4564-919c-1b0ff6518716 backed by image 6c1a0936-5c7c-44ea-886d-7a29d46eccb7 with: {'image_id': '6c1a0936-5c7c-44ea-886d-7a29d46eccb7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4b8863e62bfd5510e32a60cceae9e081', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86793) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c416a44-3b86-48f6-bc6f-957c9246e7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e87b384-cac7-4564-919c-1b0ff6518716', 'volume_size': 1, 'image_id': '6c1a0936-5c7c-44ea-886d-7a29d46eccb7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c1a0936-5c7c-44ea-886d-7a29d46eccb7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4b8863e62bfd5510e32a60cceae9e081', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34b45958cfdc49eb856276d7a2339221', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '387d08e39f00c99486dd0a48f94e03267c066e4c29a74a24c1380d9d710175554b9ca266762eaa9b22226a8c4fb3188933a40053fc48e3234172242061638d66', 'id': '6c1a0936-5c7c-44ea-886d-7a29d46eccb7', 'created_at': datetime.datetime(2026, 9, 29, 14, 50, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c1a0936-5c7c-44ea-886d-7a29d46eccb7/file', 'properties': {}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389a1aeb-712f-49f6-8ad4-3b33ca86b3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:05 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Volume volume-3e87b384-cac7-4564-919c-1b0ff6518716 (3e87b384-cac7-4564-919c-1b0ff6518716): created successfully Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389a1aeb-712f-49f6-8ad4-3b33ca86b3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Flow 'volume_create_manager' (c73c2556-11b0-4a58-91ae-73252ea9b624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b0ca23fd-e589-43a3-aec1-73091380452a tempest-VolumeImageDependencyTests-1368395336 None] Created volume successfully. Sep 29 16:51:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Acquiring lock "cinder-3e87b384-cac7-4564-919c-1b0ff6518716-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Lock "cinder-3e87b384-cac7-4564-919c-1b0ff6518716-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Acquiring lock "cinder-quobyte-3e87b384-cac7-4564-919c-1b0ff6518716" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Lock "cinder-quobyte-3e87b384-cac7-4564-919c-1b0ff6518716" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:06 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8082e0-9122-4e2d-923f-b03ae89e44ec]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:06 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 Sep 29 16:51:06 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:07 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716" returned: 0 in 0.362s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:07 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716 Sep 29 16:51:07 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:07 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e87b384-cac7-4564-919c-1b0ff6518716" returned: 0 in 0.242s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Lock "cinder-quobyte-3e87b384-cac7-4564-919c-1b0ff6518716" released by "delete_volume" :: held 0.644s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:07 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Created reservations ['20e8b4b0-4f65-4f63-a3ca-8dec723255c1', '06b9a563-866d-472e-adef-1ab43497d465', 'aedb0568-e7ac-44e8-8332-b3dc2d7b426a', '38f2c898-5fb2-4af7-a54c-565032a37090'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:07 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:07 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:07 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.257s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:07 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:07 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Deleted volume successfully. Sep 29 16:51:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5792e07d-e984-4847-bf40-e36040bc0a49 tempest-VolumeImageDependencyTests-1368395336 None] Lock "cinder-3e87b384-cac7-4564-919c-1b0ff6518716-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:17 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=62,cinder:UPDATE=85,cinder:INSERT=20,cinder:DELETE=9 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:51:17 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:UPDATE=86,cinder:SELECT=65,cinder:INSERT=29,cinder:DELETE=6 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Flow 'volume_create_manager' (81028e23-6cd0-4a09-b342-9d8c2bef0765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86d4322-f7bd-4d30-b14d-7b1e41aa0fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86d4322-f7bd-4d30-b14d-7b1e41aa0fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-145826244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e2c482-1452-40cd-8d36-c32f7bb4a8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8398459ca02742428f7bf8c2e67af49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:24Z,use_quota=True,user_id='1861ba4758db4b2ba8fbecf7eddc7f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa17896-1150-4936-9106-9e6888f2cc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa17896-1150-4936-9106-9e6888f2cc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76d0a2e-d517-4425-8d28-351e0698baaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76d0a2e-d517-4425-8d28-351e0698baaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7e2c482-1452-40cd-8d36-c32f7bb4a8c6', 'volume_name': 'volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad6605e-8d67-4a75-bc30-fb531d7ba2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad6605e-8d67-4a75-bc30-fb531d7ba2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54719794-2cf2-4803-b4ef-900b45a932e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:23 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Volume f7e2c482-1452-40cd-8d36-c32f7bb4a8c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6', 'volume_size': 1} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-145826244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e2c482-1452-40cd-8d36-c32f7bb4a8c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8398459ca02742428f7bf8c2e67af49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:24Z,use_quota=True,user_id='1861ba4758db4b2ba8fbecf7eddc7f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Creating volume f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:23 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:23 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 1073741824 Sep 29 16:51:23 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Flow 'volume_create_manager' (18bcf9bf-0e93-4216-a007-6a6b74348cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8967e7ce-551b-498f-a51e-bb1610a5b16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8967e7ce-551b-498f-a51e-bb1610a5b16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2064860712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b248ab19-0ab6-47ff-ae44-dceea3b000c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4b1eb5d4bf4bf090ffa4d89c80f0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:24Z,use_quota=True,user_id='16a6da6a4e4a4547935bb057f32acefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca4eac3-4dca-41c6-916c-8411311cc6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca4eac3-4dca-41c6-916c-8411311cc6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94a5e71-fd46-4c0f-92b3-772661aa4317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c94a5e71-fd46-4c0f-92b3-772661aa4317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b248ab19-0ab6-47ff-ae44-dceea3b000c0', 'volume_name': 'volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:23 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f358bc-a230-4164-897c-0e18967cef64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f358bc-a230-4164-897c-0e18967cef64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d376bc-a54c-4b85-90ae-074ffba33106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:24 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume b248ab19-0ab6-47ff-ae44-dceea3b000c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0', 'volume_size': 1} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:24 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Flow 'volume_create_manager' (edc6b30b-60b2-4bfa-90b2-b664be9783a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e917bee-a4c8-448a-bc97-a61b57c03ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 1073741824" returned: 0 in 0.571s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e917bee-a4c8-448a-bc97-a61b57c03ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1525057813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de704d48-db3a-4001-afdf-a5be097a3bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67521b78551849f0918f2dc6fb5033cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:24Z,use_quota=True,user_id='3ed3d54449ea4933b744da0ea42f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cf25a9-81ba-4e19-a7e0-e19decad5913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cf25a9-81ba-4e19-a7e0-e19decad5913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5fc6fc-634e-4a60-b5c4-71707fca73ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5fc6fc-634e-4a60-b5c4-71707fca73ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de704d48-db3a-4001-afdf-a5be097a3bfb', 'volume_name': 'volume-de704d48-db3a-4001-afdf-a5be097a3bfb', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ff9500-1595-43ff-ba5a-d76055386adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ff9500-1595-43ff-ba5a-d76055386adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac657e0-1477-4c96-a774-236f016567c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:24 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Volume de704d48-db3a-4001-afdf-a5be097a3bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de704d48-db3a-4001-afdf-a5be097a3bfb', 'volume_size': 1} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:24 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 Sep 29 16:51:24 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:24 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Flow 'volume_create_manager' (8620028e-3463-490e-872d-f5d29f6b6e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4994c9c1-32b4-4756-aad8-f2a8f11edadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6" returned: 0 in 0.450s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.972s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2064860712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b248ab19-0ab6-47ff-ae44-dceea3b000c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4b1eb5d4bf4bf090ffa4d89c80f0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:24Z,use_quota=True,user_id='16a6da6a4e4a4547935bb057f32acefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Creating volume b248ab19-0ab6-47ff-ae44-dceea3b000c0 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:24 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4994c9c1-32b4-4756-aad8-f2a8f11edadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-832929795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87aac6b-b2de-4bac-8144-ee94c1bbdb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67521b78551849f0918f2dc6fb5033cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:25Z,use_quota=True,user_id='3ed3d54449ea4933b744da0ea42f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f19e88-860f-4cc1-b6ea-e76545e29bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f19e88-860f-4cc1-b6ea-e76545e29bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:25 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 1073741824 Sep 29 16:51:25 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccae9ee-c52c-49b1-be83-f47bfb408a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccae9ee-c52c-49b1-be83-f47bfb408a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f87aac6b-b2de-4bac-8144-ee94c1bbdb67', 'volume_name': 'volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ed9f45-344c-421b-9277-f999bcf521bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ed9f45-344c-421b-9277-f999bcf521bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8c274b-8af8-413e-aab8-8fa6ef9f5b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:25 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Volume f87aac6b-b2de-4bac-8144-ee94c1bbdb67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67', 'volume_size': 1} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54719794-2cf2-4803-b4ef-900b45a932e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405b8e9d-83a3-4846-ae54-12f10a7725ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:25 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Volume volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 (f7e2c482-1452-40cd-8d36-c32f7bb4a8c6): created successfully Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (405b8e9d-83a3-4846-ae54-12f10a7725ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Flow 'volume_create_manager' (81028e23-6cd0-4a09-b342-9d8c2bef0765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:25 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f6090085-5cd6-49dd-be66-bbd0fc92130c tempest-VolumeDependencyTests-2038093444 None] Created volume successfully. Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Flow 'volume_create_manager' (d4042db3-47ff-4a18-a467-1dbf4e0be1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a4142a-8a7b-408b-a2e8-686cd96048e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a4142a-8a7b-408b-a2e8-686cd96048e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-59538726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee217ca7-cdf3-462f-b584-c02ee967b9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67521b78551849f0918f2dc6fb5033cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:25Z,use_quota=True,user_id='3ed3d54449ea4933b744da0ea42f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9cb1f4-e4b0-422e-8ea6-2257c245c824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9cb1f4-e4b0-422e-8ea6-2257c245c824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dacd0b1-080b-4676-9fda-c4de1acd57e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dacd0b1-080b-4676-9fda-c4de1acd57e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee217ca7-cdf3-462f-b584-c02ee967b9d9', 'volume_name': 'volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f967623d-effe-48b6-ae81-08b6a092df77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f967623d-effe-48b6-ae81-08b6a092df77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2c3af4-043a-4176-81fb-65c140b51bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:25 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Volume ee217ca7-cdf3-462f-b584-c02ee967b9d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9', 'volume_size': 1} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:25 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 1073741824" returned: 0 in 0.649s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:25 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 Sep 29 16:51:25 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Flow 'volume_create_manager' (2f3b412a-8534-496f-8e43-417d78dc3037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64829aa0-d1c7-4518-9a0a-b319c75d4636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64829aa0-d1c7-4518-9a0a-b319c75d4636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1783420634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa133af3-5770-4bae-8fe9-617669950051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67521b78551849f0918f2dc6fb5033cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:26Z,use_quota=True,user_id='3ed3d54449ea4933b744da0ea42f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddbfa2d1-0c1e-4535-9829-385ef965a74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddbfa2d1-0c1e-4535-9829-385ef965a74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79ca33f-1d58-4cc5-b4ed-8676f09c8ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79ca33f-1d58-4cc5-b4ed-8676f09c8ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa133af3-5770-4bae-8fe9-617669950051', 'volume_name': 'volume-fa133af3-5770-4bae-8fe9-617669950051', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcaddf5-2cbd-41b8-a4b9-6f83b1975fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcaddf5-2cbd-41b8-a4b9-6f83b1975fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24375c9c-e61b-4086-b27f-bb3e3a07d31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:26 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Volume fa133af3-5770-4bae-8fe9-617669950051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa133af3-5770-4bae-8fe9-617669950051', 'volume_size': 1} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:26 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0" returned: 0 in 0.389s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.596s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1525057813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de704d48-db3a-4001-afdf-a5be097a3bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67521b78551849f0918f2dc6fb5033cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:24Z,use_quota=True,user_id='3ed3d54449ea4933b744da0ea42f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Creating volume de704d48-db3a-4001-afdf-a5be097a3bfb {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:26 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de704d48-db3a-4001-afdf-a5be097a3bfb 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:26 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de704d48-db3a-4001-afdf-a5be097a3bfb 1073741824 Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d376bc-a54c-4b85-90ae-074ffba33106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:26 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d6a822-fb00-47d6-9f65-faf62ff6936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:26 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 (b248ab19-0ab6-47ff-ae44-dceea3b000c0): created successfully Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d6a822-fb00-47d6-9f65-faf62ff6936b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Flow 'volume_create_manager' (18bcf9bf-0e93-4216-a007-6a6b74348cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:26 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a6959b92-c140-4c30-954f-5eb240af2ce4 tempest-CreateVolumesFromSnapshotTest-367293029 None] Created volume successfully. Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Flow 'volume_create_manager' (1b47271c-572a-489c-888b-11264d7bcc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72639ef-a888-4cc4-b22a-9899c54b65b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72639ef-a888-4cc4-b22a-9899c54b65b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1028592344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd7f041-92a5-4211-8163-8629c06aaa69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67521b78551849f0918f2dc6fb5033cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:26Z,use_quota=True,user_id='3ed3d54449ea4933b744da0ea42f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f046e3-710d-4e2b-98e8-3521de03ed60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f046e3-710d-4e2b-98e8-3521de03ed60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4c8d45-2437-4354-9387-f4af0ff434b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4c8d45-2437-4354-9387-f4af0ff434b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cd7f041-92a5-4211-8163-8629c06aaa69', 'volume_name': 'volume-8cd7f041-92a5-4211-8163-8629c06aaa69', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6a5ebe-ed41-492a-a0da-aa7e9d40b0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6a5ebe-ed41-492a-a0da-aa7e9d40b0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3997c6a-ed6e-4e6a-b6be-573b75b10dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:26 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Volume 8cd7f041-92a5-4211-8163-8629c06aaa69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cd7f041-92a5-4211-8163-8629c06aaa69', 'volume_size': 1} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:26 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de704d48-db3a-4001-afdf-a5be097a3bfb 1073741824" returned: 0 in 0.529s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de704d48-db3a-4001-afdf-a5be097a3bfb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:26 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de704d48-db3a-4001-afdf-a5be097a3bfb Sep 29 16:51:26 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:26 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de704d48-db3a-4001-afdf-a5be097a3bfb" returned: 0 in 0.256s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.882s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-832929795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f87aac6b-b2de-4bac-8144-ee94c1bbdb67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67521b78551849f0918f2dc6fb5033cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:25Z,use_quota=True,user_id='3ed3d54449ea4933b744da0ea42f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Creating volume f87aac6b-b2de-4bac-8144-ee94c1bbdb67 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:26 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac657e0-1477-4c96-a774-236f016567c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de704d48-db3a-4001-afdf-a5be097a3bfb', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9aaf8da-c328-4a69-bff8-90d54130e44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:26 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67 1073741824 Sep 29 16:51:26 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:27 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Volume volume-de704d48-db3a-4001-afdf-a5be097a3bfb (de704d48-db3a-4001-afdf-a5be097a3bfb): created successfully Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9aaf8da-c328-4a69-bff8-90d54130e44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Flow 'volume_create_manager' (edc6b30b-60b2-4bfa-90b2-b664be9783a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:27 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-02e2d425-ec28-41a2-91ff-7fda8bc4c1f6 tempest-CreateVolumesFromImageTest-165849929 None] Created volume successfully. Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:27 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67 1073741824" returned: 0 in 0.517s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:27 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67 Sep 29 16:51:27 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:27 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67" returned: 0 in 0.259s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.304s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-59538726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee217ca7-cdf3-462f-b584-c02ee967b9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67521b78551849f0918f2dc6fb5033cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:25Z,use_quota=True,user_id='3ed3d54449ea4933b744da0ea42f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Creating volume ee217ca7-cdf3-462f-b584-c02ee967b9d9 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:27 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:27 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9 1073741824 Sep 29 16:51:27 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d8c274b-8af8-413e-aab8-8fa6ef9f5b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00712de5-200f-4930-83e5-4f4025346044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:27 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Volume volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67 (f87aac6b-b2de-4bac-8144-ee94c1bbdb67): created successfully Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00712de5-200f-4930-83e5-4f4025346044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Flow 'volume_create_manager' (8620028e-3463-490e-872d-f5d29f6b6e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:27 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e346a79b-7192-45af-9abb-7b46a7196954 tempest-CreateVolumesFromImageTest-165849929 None] Created volume successfully. Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Flow 'volume_create_manager' (d0189379-0f63-4f6e-b511-df8275c50e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127387ee-a53e-4b7b-a3f0-54083270fd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127387ee-a53e-4b7b-a3f0-54083270fd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbf5759-fa00-427f-9f3c-cc7b4f57668b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4995555fe9bf4c49ac2154bf54987df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:28Z,use_quota=True,user_id='50770b5f33274408a6336f16f6624687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffa31040-fa90-4ee4-b883-17850ac30a6d),volume_type_id=ffa31040-fa90-4ee4-b883-17850ac30a6d)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8e31c8-91ea-40fe-9167-989bf710cb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8e31c8-91ea-40fe-9167-989bf710cb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86fa9a1-ef84-45e8-821a-3af0eba0120d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.image.glance [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Creating Keystone auth plugin from conf {{(pid=86793) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 16:51:28 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9 1073741824" returned: 0 in 0.454s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:28 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9 Sep 29 16:51:28 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86fa9a1-ef84-45e8-821a-3af0eba0120d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fdbf5759-fa00-427f-9f3c-cc7b4f57668b', 'volume_name': 'volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b', 'volume_size': 1, 'image_id': '3322e5e7-4a08-4b6d-94c3-33bd49ea1cee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3322e5e7-4a08-4b6d-94c3-33bd49ea1cee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fab8c1973abf27c01610698a49d444d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4995555fe9bf4c49ac2154bf54987df8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a971e5b3542e9cde97443b543eaa728ee7b905bc6e1561fdbd4f7a5ed01fffa4e71e373f468144c6a339ed395320fa424cc420b22d6ae22a9f74676e947e0148', 'id': '3322e5e7-4a08-4b6d-94c3-33bd49ea1cee', 'created_at': datetime.datetime(2026, 9, 29, 14, 51, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 51, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3322e5e7-4a08-4b6d-94c3-33bd49ea1cee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036a004a-842e-4be2-9fc9-cfda5a4b8600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036a004a-842e-4be2-9fc9-cfda5a4b8600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250ed630-3fd0-4947-9fb4-4c7eaf5c5670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:28 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Volume fdbf5759-fa00-427f-9f3c-cc7b4f57668b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b', 'volume_size': 1, 'image_id': '3322e5e7-4a08-4b6d-94c3-33bd49ea1cee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3322e5e7-4a08-4b6d-94c3-33bd49ea1cee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fab8c1973abf27c01610698a49d444d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4995555fe9bf4c49ac2154bf54987df8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a971e5b3542e9cde97443b543eaa728ee7b905bc6e1561fdbd4f7a5ed01fffa4e71e373f468144c6a339ed395320fa424cc420b22d6ae22a9f74676e947e0148', 'id': '3322e5e7-4a08-4b6d-94c3-33bd49ea1cee', 'created_at': datetime.datetime(2026, 9, 29, 14, 51, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 51, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3322e5e7-4a08-4b6d-94c3-33bd49ea1cee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Trying to clone fdbf5759-fa00-427f-9f3c-cc7b4f57668b from image 3322e5e7-4a08-4b6d-94c3-33bd49ea1cee at location (None, [{'url': 'file:///opt/stack/data/glance/images/3322e5e7-4a08-4b6d-94c3-33bd49ea1cee', 'metadata': {}}]). {{(pid=86793) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 16:51:28 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Image download 0.00 MB at 0.00 MB/s Sep 29 16:51:28 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9" returned: 0 in 0.255s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.528s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1783420634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa133af3-5770-4bae-8fe9-617669950051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67521b78551849f0918f2dc6fb5033cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:26Z,use_quota=True,user_id='3ed3d54449ea4933b744da0ea42f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Creating volume fa133af3-5770-4bae-8fe9-617669950051 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:28 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa133af3-5770-4bae-8fe9-617669950051 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:28 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa133af3-5770-4bae-8fe9-617669950051 1073741824 Sep 29 16:51:28 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2c3af4-043a-4176-81fb-65c140b51bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2345b6fe-309a-4e50-8583-be74a7487be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a903b00-086e-48e7-9611-3d1b910cb707]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:28 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Volume volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9 (ee217ca7-cdf3-462f-b584-c02ee967b9d9): created successfully Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2345b6fe-309a-4e50-8583-be74a7487be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Flow 'volume_create_manager' (d4042db3-47ff-4a18-a467-1dbf4e0be1c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:28 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-bf2d4ffd-68d9-45bf-af8b-30081f04240f tempest-CreateVolumesFromImageTest-165849929 None] Created volume successfully. Sep 29 16:51:28 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD Sep 29 16:51:28 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:28 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:28 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa133af3-5770-4bae-8fe9-617669950051 1073741824" returned: 0 in 0.440s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa133af3-5770-4bae-8fe9-617669950051 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:29 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa133af3-5770-4bae-8fe9-617669950051 Sep 29 16:51:29 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:29 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD Sep 29 16:51:29 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:29 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa133af3-5770-4bae-8fe9-617669950051" returned: 0 in 0.262s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.829s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:29 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] Creating offline snapshot 400f1e14-3659-4146-9ae7-57fc67fb5205 of volume f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD" returned: 1 in 0.351s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Temporary image 3322e5e7-4a08-4b6d-94c3-33bd49ea1cee is fetched for user 50770b5f33274408a6336f16f6624687. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24375c9c-e61b-4086-b27f-bb3e3a07d31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa133af3-5770-4bae-8fe9-617669950051', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd6615b-db36-4275-a8f8-450d4b19c9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8220d51e-2f55-4787-a70b-d778371474c8]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:29 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Volume volume-fa133af3-5770-4bae-8fe9-617669950051 (fa133af3-5770-4bae-8fe9-617669950051): created successfully Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd6615b-db36-4275-a8f8-450d4b19c9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Flow 'volume_create_manager' (2f3b412a-8534-496f-8e43-417d78dc3037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:29 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-d1bcca3a-d84f-4f0a-8eb5-894b2437b5c2 tempest-CreateVolumesFromImageTest-165849929 None] Created volume successfully. Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1858c166-7afc-4bb5-ae75-eec09c0a82ef]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:29 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 Sep 29 16:51:29 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:29 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD Sep 29 16:51:29 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:29 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6" returned: 0 in 0.393s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:29 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:29 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 1G Sep 29 16:51:29 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:29 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD Sep 29 16:51:29 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:30 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:51:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:30 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 1G" returned: 0 in 0.413s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:30 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 Sep 29 16:51:30 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:30 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205" returned: 0 in 0.283s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:30 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 is being set with open permissions: ugo+rw Sep 29 16:51:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:30 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 Sep 29 16:51:30 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:30 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205" returned: 0 in 0.238s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:30 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.info Sep 29 16:51:30 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:30 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.info" returned: 0 in 0.283s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:31 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.info is being set with open permissions: ugo+rw Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:31 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.info Sep 29 16:51:31 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:31 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.info" returned: 0 in 0.249s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.687s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1028592344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cd7f041-92a5-4211-8163-8629c06aaa69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67521b78551849f0918f2dc6fb5033cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:26Z,use_quota=True,user_id='3ed3d54449ea4933b744da0ea42f34d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Creating volume 8cd7f041-92a5-4211-8163-8629c06aaa69 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:31 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8cd7f041-92a5-4211-8163-8629c06aaa69 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:31 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8cd7f041-92a5-4211-8163-8629c06aaa69 1073741824 Sep 29 16:51:31 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:31 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7ba5d1c8-b2f6-49b3-890f-fc6dbb32d9ee tempest-VolumeDependencyTests-2038093444 None] Create snapshot completed successfully Sep 29 16:51:31 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8cd7f041-92a5-4211-8163-8629c06aaa69 1073741824" returned: 0 in 0.417s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8cd7f041-92a5-4211-8163-8629c06aaa69 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:31 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8cd7f041-92a5-4211-8163-8629c06aaa69 Sep 29 16:51:31 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:31 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8cd7f041-92a5-4211-8163-8629c06aaa69" returned: 0 in 0.244s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.813s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] Creating offline snapshot 6b48218c-6a09-473f-9a21-6560d4d38fad of volume b248ab19-0ab6-47ff-ae44-dceea3b000c0 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:51:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3997c6a-ed6e-4e6a-b6be-573b75b10dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cd7f041-92a5-4211-8163-8629c06aaa69', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa179d76-d86c-4178-b6c6-e2c3d8d5db37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:32 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0707944d-2278-4d31-bf36-c042102903e4]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:32 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Volume volume-8cd7f041-92a5-4211-8163-8629c06aaa69 (8cd7f041-92a5-4211-8163-8629c06aaa69): created successfully Sep 29 16:51:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa179d76-d86c-4178-b6c6-e2c3d8d5db37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Flow 'volume_create_manager' (1b47271c-572a-489c-888b-11264d7bcc5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:32 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-234355f5-a939-471f-8904-63f085265d0e tempest-CreateVolumesFromImageTest-165849929 None] Created volume successfully. Sep 29 16:51:32 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 Sep 29 16:51:32 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:32 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0" returned: 0 in 0.368s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:32 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad 1G Sep 29 16:51:32 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:32 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad 1G" returned: 0 in 0.461s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:32 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad Sep 29 16:51:32 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "cinder-8cd7f041-92a5-4211-8163-8629c06aaa69-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-8cd7f041-92a5-4211-8163-8629c06aaa69-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Flow 'volume_create_manager' (4ab182c5-b6f1-4956-8fde-51f39d1adcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b21ec2e-7c38-4ab7-a8de-c6b3d914ef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b21ec2e-7c38-4ab7-a8de-c6b3d914ef87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1563902476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=befede60-3db8-42d7-86db-28da814cad36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8398459ca02742428f7bf8c2e67af49d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=400f1e14-3659-4146-9ae7-57fc67fb5205,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:33Z,use_quota=True,user_id='1861ba4758db4b2ba8fbecf7eddc7f73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd6f36a-a5f9-4071-9ec0-db0b03cfa852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd6f36a-a5f9-4071-9ec0-db0b03cfa852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e3787f-0e61-48ec-be2e-3733fc71bace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e3787f-0e61-48ec-be2e-3733fc71bace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'befede60-3db8-42d7-86db-28da814cad36', 'volume_name': 'volume-befede60-3db8-42d7-86db-28da814cad36', 'volume_size': 1, 'snapshot_id': '400f1e14-3659-4146-9ae7-57fc67fb5205'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21ec6a1-4e89-4ac2-a90a-6b26e8cd5dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21ec6a1-4e89-4ac2-a90a-6b26e8cd5dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01291faf-116f-47a0-89ec-0efa7273c76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:33 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Volume befede60-3db8-42d7-86db-28da814cad36: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-befede60-3db8-42d7-86db-28da814cad36', 'volume_size': 1, 'snapshot_id': '400f1e14-3659-4146-9ae7-57fc67fb5205'} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "cinder-quobyte-8cd7f041-92a5-4211-8163-8629c06aaa69" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-quobyte-8cd7f041-92a5-4211-8163-8629c06aaa69" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:33 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad" returned: 0 in 0.325s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:33 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad is being set with open permissions: ugo+rw Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee5f865-4cf2-44cd-8178-0ab8f377a825]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8cd7f041-92a5-4211-8163-8629c06aaa69 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:33 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad Sep 29 16:51:33 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:33 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8cd7f041-92a5-4211-8163-8629c06aaa69 Sep 29 16:51:33 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:33 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad" returned: 0 in 0.250s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:33 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.info Sep 29 16:51:33 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:33 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8cd7f041-92a5-4211-8163-8629c06aaa69" returned: 0 in 0.366s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8cd7f041-92a5-4211-8163-8629c06aaa69 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:33 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8cd7f041-92a5-4211-8163-8629c06aaa69 Sep 29 16:51:33 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:33 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.info" returned: 0 in 0.252s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:33 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.info is being set with open permissions: ugo+rw Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:33 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.info Sep 29 16:51:33 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:33 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-8cd7f041-92a5-4211-8163-8629c06aaa69" returned: 0 in 0.252s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-quobyte-8cd7f041-92a5-4211-8163-8629c06aaa69" released by "delete_volume" :: held 0.664s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Created reservations ['5b55730f-aa2e-4af5-a499-e2e028213474', '34c3c8a7-f55b-4983-9704-87e690a040b7', 'ff64577d-ea2e-4961-b21b-fdac18f7ec23', '7cd57462-1412-483b-ac3a-126600fa8b0a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:33 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.info" returned: 0 in 0.271s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:33 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:33 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.026s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.891s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbf5759-fa00-427f-9f3c-cc7b4f57668b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4995555fe9bf4c49ac2154bf54987df8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:28Z,use_quota=True,user_id='50770b5f33274408a6336f16f6624687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffa31040-fa90-4ee4-b883-17850ac30a6d),volume_type_id=ffa31040-fa90-4ee4-b883-17850ac30a6d)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Creating volume fdbf5759-fa00-427f-9f3c-cc7b4f57668b {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:34 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:34 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b 1073741824 Sep 29 16:51:34 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:34 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7642e1dd-cd0c-4802-955e-af462ace20f9 tempest-CreateVolumesFromSnapshotTest-367293029 None] Create snapshot completed successfully Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "cinder-fa133af3-5770-4bae-8fe9-617669950051-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-fa133af3-5770-4bae-8fe9-617669950051-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:34 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.274s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:34 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Deleted volume successfully. Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "cinder-quobyte-fa133af3-5770-4bae-8fe9-617669950051" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-quobyte-fa133af3-5770-4bae-8fe9-617669950051" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b6f77e-065d-4d6a-b3d2-7abe35eb13b3 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-8cd7f041-92a5-4211-8163-8629c06aaa69-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb88fe4-92ba-4030-a070-afb416369ea0]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa133af3-5770-4bae-8fe9-617669950051 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:34 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa133af3-5770-4bae-8fe9-617669950051 Sep 29 16:51:34 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:34 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b 1073741824" returned: 0 in 0.542s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:34 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b Sep 29 16:51:34 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:34 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa133af3-5770-4bae-8fe9-617669950051" returned: 0 in 0.396s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa133af3-5770-4bae-8fe9-617669950051 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:34 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa133af3-5770-4bae-8fe9-617669950051 Sep 29 16:51:34 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:34 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:34 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:34 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b" returned: 0 in 0.309s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.764s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "cinder-quobyte-400f1e14-3659-4146-9ae7-57fc67fb5205-befede60-3db8-42d7-86db-28da814cad36" by "_create_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-quobyte-400f1e14-3659-4146-9ae7-57fc67fb5205-befede60-3db8-42d7-86db-28da814cad36" acquired by "_create_volume_from_snapshot" :: waited 0.057s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Creating volume befede60-3db8-42d7-86db-28da814cad36 from snapshot 400f1e14-3659-4146-9ae7-57fc67fb5205 {{(pid=86793) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "cinder-quobyte-befede60-3db8-42d7-86db-28da814cad36" by "_copy_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:35 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Attempting download of 3322e5e7-4a08-4b6d-94c3-33bd49ea1cee ((None, [{'url': 'file:///opt/stack/data/glance/images/3322e5e7-4a08-4b6d-94c3-33bd49ea1cee', 'metadata': {}}])) to volume fdbf5759-fa00-427f-9f3c-cc7b4f57668b. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-quobyte-befede60-3db8-42d7-86db-28da814cad36" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] snapshot: 400f1e14-3659-4146-9ae7-57fc67fb5205, volume: befede60-3db8-42d7-86db-28da814cad36, {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fa133af3-5770-4bae-8fe9-617669950051" returned: 0 in 0.363s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Flow 'volume_create_manager' (d175b2f0-56c2-4ef3-9376-721b633927d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b132749-5a65-468e-a323-adb39711ef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b132749-5a65-468e-a323-adb39711ef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-61549262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9203b0d0-fbc9-4a24-825d-3df4adb5a436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4b1eb5d4bf4bf090ffa4d89c80f0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:35Z,use_quota=True,user_id='16a6da6a4e4a4547935bb057f32acefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17401ff-0bd7-4682-bd56-e609a0729d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17401ff-0bd7-4682-bd56-e609a0729d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39116319-cc41-4aa7-898e-060bd6e44f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39116319-cc41-4aa7-898e-060bd6e44f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9203b0d0-fbc9-4a24-825d-3df4adb5a436', 'volume_name': 'volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7afe54-2297-4b99-8e61-76f08251a7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7afe54-2297-4b99-8e61-76f08251a7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6310bb-2b16-46e7-91d7-9072fc4f7c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:35 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume 9203b0d0-fbc9-4a24-825d-3df4adb5a436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436', 'volume_size': 1} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-quobyte-fa133af3-5770-4bae-8fe9-617669950051" released by "delete_volume" :: held 0.945s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac42a045-23c7-4e47-a5d9-195da68f03b4]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e87fd0a-a2be-47cf-ad56-77e3fb9cb398]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_7sx8c30h {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Created reservations ['e3313288-76ba-40d5-9bdd-1b4dc67c87cf', 'db5582c5-1a86-49b4-b5e2-779ff60542cb', '7f290698-4884-4fde-a5e3-30f370e847e8', 'cc9e47aa-e540-42cf-9a10-03df89583c50'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:35 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:35 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 Sep 29 16:51:35 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.534s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:51:35 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_7sx8c30h Sep 29 16:51:35 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:35 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:35 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Flow 'volume_create_manager' (d80ed20f-24d6-4990-afbc-36f08f2acf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3834bcaf-55f4-4c9c-bc03-a00af961348e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3834bcaf-55f4-4c9c-bc03-a00af961348e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2066010298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4b1eb5d4bf4bf090ffa4d89c80f0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:35Z,use_quota=True,user_id='16a6da6a4e4a4547935bb057f32acefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d62c4c9-c18c-4b4e-8142-769f2fccaa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d62c4c9-c18c-4b4e-8142-769f2fccaa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79f5ba7-af27-4d1f-ac23-17fdd971574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79f5ba7-af27-4d1f-ac23-17fdd971574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31', 'volume_name': 'volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372eaf5d-6fa6-40b4-afeb-b752fd271c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372eaf5d-6fa6-40b4-afeb-b752fd271c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac7c73d-ea66-4436-a9b6-58406b110e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:35 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31', 'volume_size': 1} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:35 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205" returned: 0 in 0.515s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[39377b22-3633-4c54-aef2-7a875650ab29]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:35 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_7sx8c30h" returned: 0 in 0.660s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_7sx8c30h {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:35 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 Sep 29 16:51:35 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Flow 'volume_create_manager' (f1ee87f8-d6d2-4144-b16f-2a86452a87b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4d0d9b-f67c-4394-9b23-6d47cd01159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4d0d9b-f67c-4394-9b23-6d47cd01159a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1648053036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248b0bfe-23f1-4024-947a-a5d6b1cf4f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4b1eb5d4bf4bf090ffa4d89c80f0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:36Z,use_quota=True,user_id='16a6da6a4e4a4547935bb057f32acefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:35 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc35403-4677-44a1-b01d-7c4653f10692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc35403-4677-44a1-b01d-7c4653f10692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2845d5-9693-451c-b678-24b846316acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2845d5-9693-451c-b678-24b846316acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '248b0bfe-23f1-4024-947a-a5d6b1cf4f55', 'volume_name': 'volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6321e47c-9147-45e3-b428-e06460ab879f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6321e47c-9147-45e3-b428-e06460ab879f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c662b29-d58d-4322-88b5-fc19a9f983bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:36 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume 248b0bfe-23f1-4024-947a-a5d6b1cf4f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55', 'volume_size': 1} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.468s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:36 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Deleted volume successfully. Sep 29 16:51:36 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_7sx8c30h Sep 29 16:51:36 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-9c1ac8a4-a014-48db-84f1-d401c1854c55 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-fa133af3-5770-4bae-8fe9-617669950051-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:36 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6" returned: 0 in 0.529s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] will copy from snapshot at /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Creating direct copy from snapshot {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.utils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Path /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36 not found in is_blk_device check {{(pid=86793) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:36 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_7sx8c30h" returned: 1 in 0.419s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_7sx8c30h' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7804e8ca-3482-4929-88e8-1adf44b7878f]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:36 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36 Sep 29 16:51:36 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Flow 'volume_create_manager' (346ac6b0-d7db-4128-b99a-b7ba081205a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:36 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD Sep 29 16:51:36 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dcf4e95-cb16-4650-83d4-a969190fec17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dcf4e95-cb16-4650-83d4-a969190fec17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1601203349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ab6cc0-34ba-47e1-8294-bcb360add98b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4b1eb5d4bf4bf090ffa4d89c80f0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:36Z,use_quota=True,user_id='16a6da6a4e4a4547935bb057f32acefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3ab993-4c2b-430a-9381-86b547ed839d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3ab993-4c2b-430a-9381-86b547ed839d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1bfe87-f6f0-4c22-a95d-a58d49a3ac6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1bfe87-f6f0-4c22-a95d-a58d49a3ac6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ab6cc0-34ba-47e1-8294-bcb360add98b', 'volume_name': 'volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52afc214-9e2c-4b8e-9b6a-5fc25dbd3d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52afc214-9e2c-4b8e-9b6a-5fc25dbd3d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec60626-5769-4c8e-829c-1817ad7b5eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:36 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume b5ab6cc0-34ba-47e1-8294-bcb360add98b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b', 'volume_size': 1} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "cinder-ee217ca7-cdf3-462f-b584-c02ee967b9d9-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-ee217ca7-cdf3-462f-b584-c02ee967b9d9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:36 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "cinder-quobyte-ee217ca7-cdf3-462f-b584-c02ee967b9d9" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-quobyte-ee217ca7-cdf3-462f-b584-c02ee967b9d9" acquired by "delete_volume" :: waited 0.054s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5cb006-f1c1-46f4-8ab1-2ac6273ed418]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:36 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD Sep 29 16:51:36 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:36 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9 Sep 29 16:51:36 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Flow 'volume_create_manager' (6c270537-5dde-41cc-83af-d9dadcab10df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b1b43d-2644-4961-9258-2734da1c051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b1b43d-2644-4961-9258-2734da1c051c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1019920420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789913a3-b72f-400b-9d07-8acbf371a7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4b1eb5d4bf4bf090ffa4d89c80f0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:37Z,use_quota=True,user_id='16a6da6a4e4a4547935bb057f32acefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272f2cbc-3aab-4429-99ef-41739d289377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (272f2cbc-3aab-4429-99ef-41739d289377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9b4769-e171-4388-99e1-fd67d31ae667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9b4769-e171-4388-99e1-fd67d31ae667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '789913a3-b72f-400b-9d07-8acbf371a7e1', 'volume_name': 'volume-789913a3-b72f-400b-9d07-8acbf371a7e1', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317d555c-b0fb-4471-90dc-cfa610848058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (317d555c-b0fb-4471-90dc-cfa610848058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8672c37f-f3e4-4dce-8cb1-863cdf726d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:37 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume 789913a3-b72f-400b-9d07-8acbf371a7e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-789913a3-b72f-400b-9d07-8acbf371a7e1', 'volume_size': 1} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:37 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD" returned: 1 in 0.718s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] 3322e5e7-4a08-4b6d-94c3-33bd49ea1cee was raw, converting to qcow2 {{(pid=86793) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 16:51:37 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9" returned: 0 in 0.651s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:37 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b Sep 29 16:51:37 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:37 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9 Sep 29 16:51:37 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:37 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ee217ca7-cdf3-462f-b584-c02ee967b9d9" returned: 0 in 0.376s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:37 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-quobyte-ee217ca7-cdf3-462f-b584-c02ee967b9d9" released by "delete_volume" :: held 1.114s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:38 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Created reservations ['bdf42538-6f23-4527-9d93-f8f727e412d3', '5eab357d-1379-4bb6-9c85-5fc4de42b8d9', '9e7c5354-0af1-46c5-b951-4ad53e1435b9', 'a6be088f-443c-4a38-9f17-c4ae60450695'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:38 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:38 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:38 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.358s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:38 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:38 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Deleted volume successfully. Sep 29 16:51:38 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3af7f848-ec52-4916-89af-71fd440fc273 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-ee217ca7-cdf3-462f-b584-c02ee967b9d9-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:38 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b" returned: 0 in 1.127s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:38 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3322e5e7-4a08-4b6d-94c3-33bd49ea1cee_dfnfy_x0devstack@QuobyteHD, size 0.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:51:38 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 16:51:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:38 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b 1G Sep 29 16:51:38 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "cinder-f87aac6b-b2de-4bac-8144-ee94c1bbdb67-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:39 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b 1G" returned: 0 in 0.557s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Downloaded image 3322e5e7-4a08-4b6d-94c3-33bd49ea1cee ((None, [{'url': 'file:///opt/stack/data/glance/images/3322e5e7-4a08-4b6d-94c3-33bd49ea1cee', 'metadata': {}}])) to volume fdbf5759-fa00-427f-9f3c-cc7b4f57668b successfully. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Temporary image 3322e5e7-4a08-4b6d-94c3-33bd49ea1cee for user 50770b5f33274408a6336f16f6624687 is deleted. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Marking volume fdbf5759-fa00-427f-9f3c-cc7b4f57668b as bootable. {{(pid=86793) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-f87aac6b-b2de-4bac-8144-ee94c1bbdb67-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Copying metadata from image 3322e5e7-4a08-4b6d-94c3-33bd49ea1cee to fdbf5759-fa00-427f-9f3c-cc7b4f57668b. {{(pid=86793) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Creating volume glance metadata for volume fdbf5759-fa00-427f-9f3c-cc7b4f57668b backed by image 3322e5e7-4a08-4b6d-94c3-33bd49ea1cee with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3322e5e7-4a08-4b6d-94c3-33bd49ea1cee', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'fab8c1973abf27c01610698a49d444d9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86793) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "cinder-quobyte-f87aac6b-b2de-4bac-8144-ee94c1bbdb67" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-quobyte-f87aac6b-b2de-4bac-8144-ee94c1bbdb67" acquired by "delete_volume" :: waited 0.047s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[315d8945-b426-41b5-b633-a231c943bfaa]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250ed630-3fd0-4947-9fb4-4c7eaf5c5670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b', 'volume_size': 1, 'image_id': '3322e5e7-4a08-4b6d-94c3-33bd49ea1cee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3322e5e7-4a08-4b6d-94c3-33bd49ea1cee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fab8c1973abf27c01610698a49d444d9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4995555fe9bf4c49ac2154bf54987df8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a971e5b3542e9cde97443b543eaa728ee7b905bc6e1561fdbd4f7a5ed01fffa4e71e373f468144c6a339ed395320fa424cc420b22d6ae22a9f74676e947e0148', 'id': '3322e5e7-4a08-4b6d-94c3-33bd49ea1cee', 'created_at': datetime.datetime(2026, 9, 29, 14, 51, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 51, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3322e5e7-4a08-4b6d-94c3-33bd49ea1cee/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d95cf19-3c10-4d59-8d65-aa68ab3645ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:39 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Volume volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b (fdbf5759-fa00-427f-9f3c-cc7b4f57668b): created successfully Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d95cf19-3c10-4d59-8d65-aa68ab3645ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Flow 'volume_create_manager' (d0189379-0f63-4f6e-b511-df8275c50e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:39 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7b66ceee-e7d0-4972-9890-544beeef3faf tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Created volume successfully. Sep 29 16:51:39 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67 Sep 29 16:51:39 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:40 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67" returned: 0 in 0.685s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:40 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67 Sep 29 16:51:40 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Acquiring lock "cinder-fdbf5759-fa00-427f-9f3c-cc7b4f57668b-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Lock "cinder-fdbf5759-fa00-427f-9f3c-cc7b4f57668b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Acquiring lock "cinder-quobyte-fdbf5759-fa00-427f-9f3c-cc7b4f57668b" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Lock "cinder-quobyte-fdbf5759-fa00-427f-9f3c-cc7b4f57668b" acquired by "delete_volume" :: waited 0.064s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:40 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[33688328-aaac-477d-933b-0507f88e01e9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f87aac6b-b2de-4bac-8144-ee94c1bbdb67" returned: 0 in 0.571s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-quobyte-f87aac6b-b2de-4bac-8144-ee94c1bbdb67" released by "delete_volume" :: held 1.361s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Created reservations ['4cf37e43-4f0b-4d87-a733-964bc59dea97', 'bcb033aa-6bd9-4352-8944-8b6b00bc5588', '08481483-988f-4745-af5f-3de6236c39f0', '49db604e-4491-4d4e-b4f4-1108c0bb5fc3'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:40 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b Sep 29 16:51:40 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:40 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:40 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:41 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b" returned: 0 in 0.579s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:41 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b Sep 29 16:51:41 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:41 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.465s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:41 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Deleted volume successfully. Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-35baaaa2-ebfa-4a1a-be38-8a27fa083c50 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-f87aac6b-b2de-4bac-8144-ee94c1bbdb67-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "cinder-de704d48-db3a-4001-afdf-a5be097a3bfb-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-de704d48-db3a-4001-afdf-a5be097a3bfb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "cinder-quobyte-de704d48-db3a-4001-afdf-a5be097a3bfb" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-quobyte-de704d48-db3a-4001-afdf-a5be097a3bfb" acquired by "delete_volume" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:41 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-fdbf5759-fa00-427f-9f3c-cc7b4f57668b" returned: 0 in 0.556s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Lock "cinder-quobyte-fdbf5759-fa00-427f-9f3c-cc7b4f57668b" released by "delete_volume" :: held 1.238s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98293f2-6ab4-4303-874c-ccfdd950680c]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de704d48-db3a-4001-afdf-a5be097a3bfb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Created reservations ['18c0aa6b-afac-4570-959a-9cd6b8fdb78e', '8414a1ad-e46e-4443-a3b5-de8d338c14c3', 'aca19506-416d-4ae2-928f-7105a4407908', 'b9acc272-ff75-4bed-a0dd-836709542493'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:42 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de704d48-db3a-4001-afdf-a5be097a3bfb Sep 29 16:51:42 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:42 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:42 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:42 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de704d48-db3a-4001-afdf-a5be097a3bfb" returned: 0 in 0.667s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de704d48-db3a-4001-afdf-a5be097a3bfb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:42 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de704d48-db3a-4001-afdf-a5be097a3bfb Sep 29 16:51:42 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:42 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.544s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:42 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:42 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Deleted volume successfully. Sep 29 16:51:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2ea113c1-91f7-4ab3-93e5-fb8441335019 tempest-VolumeAndVolumeTypeFromImageTest-478018194 None] Lock "cinder-fdbf5759-fa00-427f-9f3c-cc7b4f57668b-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:42 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-de704d48-db3a-4001-afdf-a5be097a3bfb" returned: 0 in 0.489s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-quobyte-de704d48-db3a-4001-afdf-a5be097a3bfb" released by "delete_volume" :: held 1.276s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:43 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Created reservations ['a82c38b4-7c0e-4f19-83d8-30c929125660', 'a2ffe072-cf17-4bc0-a67d-df0eeafd1672', '2efd92a6-09cd-4fbb-8b5e-fcc4b926c302', '38acee2a-18f4-4c68-9d04-934b2ed5530f'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:43 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:43 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:43 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.447s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:43 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:43 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Deleted volume successfully. Sep 29 16:51:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ff867eb9-2e0f-4956-8ab4-c5ae04184db3 tempest-CreateVolumesFromImageTest-165849929 None] Lock "cinder-de704d48-db3a-4001-afdf-a5be097a3bfb-delete_volume" released by "delete_volume" :: held 2.102s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:44 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36" returned: 0 in 8.282s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6, size 1024.00 MB, duration 8.28 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:51:44 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Converted 1024.00 MB image at 123.62 MB/s Sep 29 16:51:44 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36 is being set with open permissions: ugo+rw Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:44 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36 Sep 29 16:51:44 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:44 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36" returned: 0 in 0.271s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-quobyte-befede60-3db8-42d7-86db-28da814cad36" released by "_copy_volume_from_snapshot" :: held 9.827s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-quobyte-400f1e14-3659-4146-9ae7-57fc67fb5205-befede60-3db8-42d7-86db-28da814cad36" released by "_create_volume_from_snapshot" :: held 9.958s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.017s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.726s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-61549262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9203b0d0-fbc9-4a24-825d-3df4adb5a436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4b1eb5d4bf4bf090ffa4d89c80f0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:35Z,use_quota=True,user_id='16a6da6a4e4a4547935bb057f32acefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Creating volume 9203b0d0-fbc9-4a24-825d-3df4adb5a436 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:44 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:44 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436 1073741824 Sep 29 16:51:44 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01291faf-116f-47a0-89ec-0efa7273c76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-befede60-3db8-42d7-86db-28da814cad36', 'volume_size': 1, 'snapshot_id': '400f1e14-3659-4146-9ae7-57fc67fb5205'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de8447d-c1e6-4706-acdd-447c4aa60774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:45 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Volume volume-befede60-3db8-42d7-86db-28da814cad36 (befede60-3db8-42d7-86db-28da814cad36): created successfully Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de8447d-c1e6-4706-acdd-447c4aa60774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Flow 'volume_create_manager' (4ab182c5-b6f1-4956-8fde-51f39d1adcb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:45 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-0d017b8c-08bb-4df5-99c7-231697e28b5d tempest-VolumeDependencyTests-2038093444 None] Created volume successfully. Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "cinder-400f1e14-3659-4146-9ae7-57fc67fb5205-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-400f1e14-3659-4146-9ae7-57fc67fb5205-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "cinder-quobyte-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-quobyte-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "cinder-quobyte-400f1e14-3659-4146-9ae7-57fc67fb5205" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-quobyte-400f1e14-3659-4146-9ae7-57fc67fb5205" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Deleting offline snapshot 400f1e14-3659-4146-9ae7-57fc67fb5205 of volume f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] snapshot_file for this snap is: volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d7244b-57bf-4599-8634-ed85bdc4416b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:45 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 Sep 29 16:51:45 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:45 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436 1073741824" returned: 0 in 0.853s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:45 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436 Sep 29 16:51:45 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:46 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205" returned: 0 in 0.648s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acae6ae-1fbb-476f-92e2-cd434873a28b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:46 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436" returned: 0 in 0.308s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.459s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2066010298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4b1eb5d4bf4bf090ffa4d89c80f0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:35Z,use_quota=True,user_id='16a6da6a4e4a4547935bb057f32acefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Creating volume dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:46 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6310bb-2b16-46e7-91d7-9072fc4f7c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03719fda-c4fd-4bc4-89fb-716f828966df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:46 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31 1073741824 Sep 29 16:51:46 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:46 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436 (9203b0d0-fbc9-4a24-825d-3df4adb5a436): created successfully Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03719fda-c4fd-4bc4-89fb-716f828966df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Flow 'volume_create_manager' (d175b2f0-56c2-4ef3-9376-721b633927d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:46 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-d706ef66-5790-4bf5-afed-b0df916ffcf6 tempest-CreateVolumesFromSnapshotTest-367293029 None] Created volume successfully. Sep 29 16:51:46 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 Sep 29 16:51:46 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:46 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31 1073741824" returned: 0 in 0.609s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:46 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6" returned: 0 in 0.723s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:46 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31 Sep 29 16:51:46 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:46 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 Sep 29 16:51:46 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:47 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31" returned: 0 in 0.331s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.161s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1648053036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248b0bfe-23f1-4024-947a-a5d6b1cf4f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4b1eb5d4bf4bf090ffa4d89c80f0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:36Z,use_quota=True,user_id='16a6da6a4e4a4547935bb057f32acefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Creating volume 248b0bfe-23f1-4024-947a-a5d6b1cf4f55 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:47 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac7c73d-ea66-4436-a9b6-58406b110e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c38b597-45dc-4f2d-a6a2-d8a9e1765637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:47 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55 1073741824 Sep 29 16:51:47 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:47 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31 (dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31): created successfully Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c38b597-45dc-4f2d-a6a2-d8a9e1765637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Flow 'volume_create_manager' (d80ed20f-24d6-4990-afbc-36f08f2acf82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:47 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-dffcaa2d-9750-4c18-b7c4-2e3205305fd5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Created volume successfully. Sep 29 16:51:47 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205" returned: 0 in 0.533s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:47 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205 Sep 29 16:51:47 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:47 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6.400f1e14-3659-4146-9ae7-57fc67fb5205" returned: 0 in 0.308s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:47 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55 1073741824" returned: 0 in 0.579s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-quobyte-400f1e14-3659-4146-9ae7-57fc67fb5205" released by "_delete_snapshot" :: held 2.383s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-quobyte-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6" released by "delete_snapshot" :: held 2.442s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:47 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55 Sep 29 16:51:47 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:47 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Created reservations ['8d8c9de2-45df-4a18-babc-fab4a2cdcb92', 'c67b97b3-160d-4b29-8a77-caae018fcc8b', '18dc234c-e3ef-4edf-9d68-1a772f50c91f', 'b941468a-d047-4896-b6b1-72ba06dd733d'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:48 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Delete snapshot completed successfully. Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-47450ead-9def-40f0-af8d-04a88a36f751 tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-400f1e14-3659-4146-9ae7-57fc67fb5205-delete_snapshot" released by "delete_snapshot" :: held 2.705s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:48 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55" returned: 0 in 0.352s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.636s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1601203349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ab6cc0-34ba-47e1-8294-bcb360add98b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4b1eb5d4bf4bf090ffa4d89c80f0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:36Z,use_quota=True,user_id='16a6da6a4e4a4547935bb057f32acefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Creating volume b5ab6cc0-34ba-47e1-8294-bcb360add98b {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:48 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:48 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b 1073741824 Sep 29 16:51:48 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c662b29-d58d-4322-88b5-fc19a9f983bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f76bc35-41f6-454d-a39b-d854fcd93300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:48 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55 (248b0bfe-23f1-4024-947a-a5d6b1cf4f55): created successfully Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f76bc35-41f6-454d-a39b-d854fcd93300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Flow 'volume_create_manager' (f1ee87f8-d6d2-4144-b16f-2a86452a87b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Flow 'volume_create_manager' (47db0252-8571-49b5-a194-ec16d796ae41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b858ebf-b62d-47ec-b420-bdd7d9f787d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b858ebf-b62d-47ec-b420-bdd7d9f787d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-255726252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55359ac2-4d84-46c1-8fe6-90fee1826581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227b26e5019842b4917409135916ef30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:48Z,use_quota=True,user_id='08c05cc87d244489b4e98384dd3202b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0724200-82ae-4ac9-bb30-c808d6b60f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0724200-82ae-4ac9-bb30-c808d6b60f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e6448c-35d5-4a9b-b694-9e52b314ba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e6448c-35d5-4a9b-b694-9e52b314ba16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55359ac2-4d84-46c1-8fe6-90fee1826581', 'volume_name': 'volume-55359ac2-4d84-46c1-8fe6-90fee1826581', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787cbb80-3aa0-4cd8-a84a-0f4cdd752405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787cbb80-3aa0-4cd8-a84a-0f4cdd752405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e501a72-5fbb-4427-914b-2199e5ebe2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:48 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume 55359ac2-4d84-46c1-8fe6-90fee1826581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55359ac2-4d84-46c1-8fe6-90fee1826581', 'volume_size': 1} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:48 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-10422e2e-884e-4716-bd76-3ae609f3d445 tempest-CreateVolumesFromSnapshotTest-367293029 None] Created volume successfully. Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "cinder-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "cinder-quobyte-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-quobyte-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6" acquired by "delete_volume" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[52eb334a-651b-49c9-8324-6cf00405d830]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:48 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b 1073741824" returned: 0 in 0.521s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:48 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b Sep 29 16:51:48 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:48 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 Sep 29 16:51:48 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:49 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b" returned: 0 in 0.258s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.653s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1019920420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789913a3-b72f-400b-9d07-8acbf371a7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4b1eb5d4bf4bf090ffa4d89c80f0b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:37Z,use_quota=True,user_id='16a6da6a4e4a4547935bb057f32acefb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Creating volume 789913a3-b72f-400b-9d07-8acbf371a7e1 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:49 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-789913a3-b72f-400b-9d07-8acbf371a7e1 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec60626-5769-4c8e-829c-1817ad7b5eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e52c21e-5bc6-4df8-b876-3ffc0a0603fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:49 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-789913a3-b72f-400b-9d07-8acbf371a7e1 1073741824 Sep 29 16:51:49 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:49 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b (b5ab6cc0-34ba-47e1-8294-bcb360add98b): created successfully Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e52c21e-5bc6-4df8-b876-3ffc0a0603fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Flow 'volume_create_manager' (346ac6b0-d7db-4128-b99a-b7ba081205a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:49 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6" returned: 0 in 0.415s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:49 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-9f7dee42-d7d8-4190-9c62-73de1edf6183 tempest-CreateVolumesFromSnapshotTest-367293029 None] Created volume successfully. Sep 29 16:51:49 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6 Sep 29 16:51:49 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:49 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6" returned: 0 in 0.293s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-quobyte-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6" released by "delete_volume" :: held 0.785s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Created reservations ['956053ee-2fbe-4217-9f4c-7d640213c390', 'afeb2b1e-5d93-4622-93f9-428db6661aac', 'b63d63be-db8d-4a83-a97e-1a5fcfa81772', 'ac205e44-e20f-4435-a0dc-68e6b10c7268'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:49 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:49 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:49 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-789913a3-b72f-400b-9d07-8acbf371a7e1 1073741824" returned: 0 in 0.629s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-789913a3-b72f-400b-9d07-8acbf371a7e1 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:49 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-789913a3-b72f-400b-9d07-8acbf371a7e1 Sep 29 16:51:49 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "cinder-befede60-3db8-42d7-86db-28da814cad36-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-befede60-3db8-42d7-86db-28da814cad36-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "cinder-quobyte-befede60-3db8-42d7-86db-28da814cad36" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-quobyte-befede60-3db8-42d7-86db-28da814cad36" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:49 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.323s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:49 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Deleted volume successfully. Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30f718f-8c89-44cc-9049-12e2161324f3]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5dee59d-7307-458a-9d90-d20a4fc08bab tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-f7e2c482-1452-40cd-8d36-c32f7bb4a8c6-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:50 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-789913a3-b72f-400b-9d07-8acbf371a7e1" returned: 0 in 0.281s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.642s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-255726252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55359ac2-4d84-46c1-8fe6-90fee1826581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227b26e5019842b4917409135916ef30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:48Z,use_quota=True,user_id='08c05cc87d244489b4e98384dd3202b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Creating volume 55359ac2-4d84-46c1-8fe6-90fee1826581 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:50 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-55359ac2-4d84-46c1-8fe6-90fee1826581 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8672c37f-f3e4-4dce-8cb1-863cdf726d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-789913a3-b72f-400b-9d07-8acbf371a7e1', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:50 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36 Sep 29 16:51:50 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb70d7d-f41c-418d-9608-74e49a804be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:50 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-55359ac2-4d84-46c1-8fe6-90fee1826581 1073741824 Sep 29 16:51:50 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:50 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Volume volume-789913a3-b72f-400b-9d07-8acbf371a7e1 (789913a3-b72f-400b-9d07-8acbf371a7e1): created successfully Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb70d7d-f41c-418d-9608-74e49a804be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Flow 'volume_create_manager' (6c270537-5dde-41cc-83af-d9dadcab10df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:50 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b9838372-02f1-4680-9940-b2507a063afc tempest-CreateVolumesFromSnapshotTest-367293029 None] Created volume successfully. Sep 29 16:51:50 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36" returned: 0 in 0.431s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:50 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36 Sep 29 16:51:50 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-789913a3-b72f-400b-9d07-8acbf371a7e1-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-789913a3-b72f-400b-9d07-8acbf371a7e1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:50 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-55359ac2-4d84-46c1-8fe6-90fee1826581 1073741824" returned: 0 in 0.568s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-quobyte-789913a3-b72f-400b-9d07-8acbf371a7e1" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-789913a3-b72f-400b-9d07-8acbf371a7e1" acquired by "delete_volume" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:50 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-befede60-3db8-42d7-86db-28da814cad36" returned: 0 in 0.303s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e99aa99-0a74-4c7a-bf6b-401ae326136d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-55359ac2-4d84-46c1-8fe6-90fee1826581 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-789913a3-b72f-400b-9d07-8acbf371a7e1 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-quobyte-befede60-3db8-42d7-86db-28da814cad36" released by "delete_volume" :: held 0.833s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:50 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-55359ac2-4d84-46c1-8fe6-90fee1826581 Sep 29 16:51:50 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Created reservations ['9a747e16-93ff-4581-8610-4c2b86f0dd52', '60a1e6a6-f0f3-4a37-a94f-4a4d85b36437', 'e3090f6c-fd06-4158-8b85-608e98ebdf3e', 'c00cf9b7-77f5-41e5-9bda-77f118b8622e'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:50 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-789913a3-b72f-400b-9d07-8acbf371a7e1 Sep 29 16:51:50 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:50 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:50 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:50 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-55359ac2-4d84-46c1-8fe6-90fee1826581" returned: 0 in 0.304s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e501a72-5fbb-4427-914b-2199e5ebe2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55359ac2-4d84-46c1-8fe6-90fee1826581', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a7880f-edd3-4ef5-a80d-7a3fe7ebe116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:51 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume volume-55359ac2-4d84-46c1-8fe6-90fee1826581 (55359ac2-4d84-46c1-8fe6-90fee1826581): created successfully Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a7880f-edd3-4ef5-a80d-7a3fe7ebe116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Flow 'volume_create_manager' (47db0252-8571-49b5-a194-ec16d796ae41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:51 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f4fe05e0-d8c1-4305-a83f-df09c86448c7 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Created volume successfully. Sep 29 16:51:51 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-789913a3-b72f-400b-9d07-8acbf371a7e1" returned: 0 in 0.535s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-789913a3-b72f-400b-9d07-8acbf371a7e1 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:51 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.364s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:51 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-789913a3-b72f-400b-9d07-8acbf371a7e1 Sep 29 16:51:51 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:51 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Deleted volume successfully. Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-91f852bf-8b4a-4d90-8af4-0affed886fdf tempest-VolumeDependencyTests-2038093444 None] Lock "cinder-befede60-3db8-42d7-86db-28da814cad36-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:51 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-789913a3-b72f-400b-9d07-8acbf371a7e1" returned: 0 in 0.301s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-789913a3-b72f-400b-9d07-8acbf371a7e1" released by "delete_volume" :: held 0.900s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Created reservations ['86ab725b-4d11-4c9a-8181-45c2d2d7b255', '7dc2055c-0fc6-46f0-8d8a-6c4c4a4cd805', '99e510a6-db22-4116-98a3-21f8d0b9d145', '5fb157d7-69df-41e6-be96-31588c2e11a7'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:51 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:51 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:52 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.411s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:52 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Deleted volume successfully. Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3365fef0-4172-4950-bfa8-6ff59f1ab4f0 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-789913a3-b72f-400b-9d07-8acbf371a7e1-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Flow 'volume_create_manager' (47f758a3-7975-4a91-aa1c-4ce199d97dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2c005f-104d-4ecb-ae91-05da1c65d1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a2c005f-104d-4ecb-ae91-05da1c65d1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-438185964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b86f261-cfb3-4aec-94fc-6e7d0b9e3892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227b26e5019842b4917409135916ef30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:52Z,use_quota=True,user_id='08c05cc87d244489b4e98384dd3202b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a8bee4-f058-4aad-9ae4-6b49739f2d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a8bee4-f058-4aad-9ae4-6b49739f2d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d49d77-00b8-412b-82a4-9c4d76100231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d49d77-00b8-412b-82a4-9c4d76100231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b86f261-cfb3-4aec-94fc-6e7d0b9e3892', 'volume_name': 'volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd93fa7-6298-4901-b655-bb58f8227ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd93fa7-6298-4901-b655-bb58f8227ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa6bc27-d2d9-4d3a-ba60-5fa3de2ce4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:52 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume 4b86f261-cfb3-4aec-94fc-6e7d0b9e3892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892', 'volume_size': 1} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-438185964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b86f261-cfb3-4aec-94fc-6e7d0b9e3892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227b26e5019842b4917409135916ef30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:52Z,use_quota=True,user_id='08c05cc87d244489b4e98384dd3202b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Creating volume 4b86f261-cfb3-4aec-94fc-6e7d0b9e3892 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:52 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:52 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892 1073741824 Sep 29 16:51:52 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Flow 'volume_create_manager' (bab9c5d1-f42b-4b42-bda9-4e45bc24ee29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960a6244-6130-4231-bf84-0ef828b7f2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960a6244-6130-4231-bf84-0ef828b7f2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1907076824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200009ba-ba02-42de-8704-e5ab419287c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227b26e5019842b4917409135916ef30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:53Z,use_quota=True,user_id='08c05cc87d244489b4e98384dd3202b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a3be07-161c-453f-9a4f-4f22d261f371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a3be07-161c-453f-9a4f-4f22d261f371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f77bbc1-29b6-4155-b160-f0f22e648e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f77bbc1-29b6-4155-b160-f0f22e648e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '200009ba-ba02-42de-8704-e5ab419287c4', 'volume_name': 'volume-200009ba-ba02-42de-8704-e5ab419287c4', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed759c4-ceb8-4616-9448-2b8bd8cdb2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed759c4-ceb8-4616-9448-2b8bd8cdb2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66503b19-f41d-40a8-bf83-47c86aa9554d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:52 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume 200009ba-ba02-42de-8704-e5ab419287c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-200009ba-ba02-42de-8704-e5ab419287c4', 'volume_size': 1} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-b5ab6cc0-34ba-47e1-8294-bcb360add98b-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-b5ab6cc0-34ba-47e1-8294-bcb360add98b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-quobyte-b5ab6cc0-34ba-47e1-8294-bcb360add98b" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-b5ab6cc0-34ba-47e1-8294-bcb360add98b" acquired by "delete_volume" :: waited 0.036s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8977a3-b432-4daf-a34d-65918bb623c0]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:53 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892 1073741824" returned: 0 in 0.757s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:53 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b Sep 29 16:51:53 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:53 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892 Sep 29 16:51:53 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Flow 'volume_create_manager' (2c64a2a7-4da5-4560-8e2e-98f2ef10cf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b178161-c488-4293-85b5-243832e0df48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b178161-c488-4293-85b5-243832e0df48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2065997173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227b26e5019842b4917409135916ef30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:53Z,use_quota=True,user_id='08c05cc87d244489b4e98384dd3202b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0281ab-0dc1-4831-b524-4af0c885d16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0281ab-0dc1-4831-b524-4af0c885d16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a19ebb8-7a2c-4692-a82f-bdb68ea445c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a19ebb8-7a2c-4692-a82f-bdb68ea445c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb', 'volume_name': 'volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35aebf1-8409-43af-9670-3c30cca70375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35aebf1-8409-43af-9670-3c30cca70375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55e7cfd-f2a3-42dd-8b58-8929f00602f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:53 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb', 'volume_size': 1} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:53 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892" returned: 0 in 0.426s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:53 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.966s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1907076824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200009ba-ba02-42de-8704-e5ab419287c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227b26e5019842b4917409135916ef30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:53Z,use_quota=True,user_id='08c05cc87d244489b4e98384dd3202b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Creating volume 200009ba-ba02-42de-8704-e5ab419287c4 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:53 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-200009ba-ba02-42de-8704-e5ab419287c4 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b" returned: 0 in 0.675s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:53 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-200009ba-ba02-42de-8704-e5ab419287c4 1073741824 Sep 29 16:51:53 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:53 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b Sep 29 16:51:53 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa6bc27-d2d9-4d3a-ba60-5fa3de2ce4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2070f7f-c308-4c21-8120-8cdf35df9657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:53 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892 (4b86f261-cfb3-4aec-94fc-6e7d0b9e3892): created successfully Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2070f7f-c308-4c21-8120-8cdf35df9657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Flow 'volume_create_manager' (47f758a3-7975-4a91-aa1c-4ce199d97dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:53 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7273dcae-80f3-4af9-b8a8-3a5189458dd4 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Created volume successfully. Sep 29 16:51:54 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b5ab6cc0-34ba-47e1-8294-bcb360add98b" returned: 0 in 0.401s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-b5ab6cc0-34ba-47e1-8294-bcb360add98b" released by "delete_volume" :: held 1.155s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Flow 'volume_create_manager' (b16bfb7c-f50a-4ee0-abf6-e3c922cfc834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64e0dbb-e55c-4e77-846b-1fb4e575f239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64e0dbb-e55c-4e77-846b-1fb4e575f239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-743570124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78af5f83-3b6a-4c60-bcc8-d683f70cfc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227b26e5019842b4917409135916ef30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:54Z,use_quota=True,user_id='08c05cc87d244489b4e98384dd3202b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d05678-033d-457c-8212-8233e5be97fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d05678-033d-457c-8212-8233e5be97fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c402d719-011c-4001-9699-f3c54f00e003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c402d719-011c-4001-9699-f3c54f00e003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78af5f83-3b6a-4c60-bcc8-d683f70cfc23', 'volume_name': 'volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c092f0d1-b90d-4a2d-8539-289df6981048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c092f0d1-b90d-4a2d-8539-289df6981048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f75e29b-8c1d-433e-aeec-f032a48c5d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:54 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume 78af5f83-3b6a-4c60-bcc8-d683f70cfc23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23', 'volume_size': 1} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Created reservations ['48671fcd-e16e-4a7b-9ea6-03ae31b5c104', 'fe515dfc-87a4-4d03-b064-9da507bf405a', '938c7f45-c8a9-4740-af43-4f0feaae5e7e', 'da2a5577-adaf-43af-8d6f-8bfae50a7a58'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:54 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:54 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:54 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Flow 'volume_create_manager' (cb22b82f-4b2c-402b-ab75-5d5a738c4aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848241b0-3b83-4797-aecb-d985f257b31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-200009ba-ba02-42de-8704-e5ab419287c4 1073741824" returned: 0 in 0.955s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848241b0-3b83-4797-aecb-d985f257b31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1854913178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540dc5b2-c0ca-4bc2-86cf-913fac797fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227b26e5019842b4917409135916ef30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:55Z,use_quota=True,user_id='08c05cc87d244489b4e98384dd3202b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404550d1-fd28-4649-a22b-0ecb4cddb02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404550d1-fd28-4649-a22b-0ecb4cddb02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fed132-44d2-4f38-9edd-e203550ea4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fed132-44d2-4f38-9edd-e203550ea4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '540dc5b2-c0ca-4bc2-86cf-913fac797fda', 'volume_name': 'volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2c2155-4ca2-451d-9e58-e008b44b764e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2c2155-4ca2-451d-9e58-e008b44b764e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385377c0-cab9-49a3-8768-b007e3f3fa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:54 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume 540dc5b2-c0ca-4bc2-86cf-913fac797fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda', 'volume_size': 1} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-200009ba-ba02-42de-8704-e5ab419287c4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:54 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-200009ba-ba02-42de-8704-e5ab419287c4 Sep 29 16:51:54 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:54 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.323s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:54 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Deleted volume successfully. Sep 29 16:51:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-98b71b73-1a20-4d94-afdd-d11d7f55812c tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-b5ab6cc0-34ba-47e1-8294-bcb360add98b-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:55 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-200009ba-ba02-42de-8704-e5ab419287c4" returned: 0 in 0.295s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.503s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2065997173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227b26e5019842b4917409135916ef30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:53Z,use_quota=True,user_id='08c05cc87d244489b4e98384dd3202b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Creating volume cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:55 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66503b19-f41d-40a8-bf83-47c86aa9554d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-200009ba-ba02-42de-8704-e5ab419287c4', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89703f4-61b2-4f20-bdd7-baec6b0722fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:55 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb 1073741824 Sep 29 16:51:55 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:55 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume volume-200009ba-ba02-42de-8704-e5ab419287c4 (200009ba-ba02-42de-8704-e5ab419287c4): created successfully Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a89703f4-61b2-4f20-bdd7-baec6b0722fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Flow 'volume_create_manager' (bab9c5d1-f42b-4b42-bda9-4e45bc24ee29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:55 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-bff0b18c-79a0-4d16-a88d-82cfd9889578 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Created volume successfully. Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-248b0bfe-23f1-4024-947a-a5d6b1cf4f55-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-248b0bfe-23f1-4024-947a-a5d6b1cf4f55-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-quobyte-248b0bfe-23f1-4024-947a-a5d6b1cf4f55" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-248b0bfe-23f1-4024-947a-a5d6b1cf4f55" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca7b4d1-7866-4cf1-b9bb-f6189c89f5e2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:55 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55 Sep 29 16:51:55 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:55 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb 1073741824" returned: 0 in 0.612s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:55 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb Sep 29 16:51:55 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:55 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55" returned: 0 in 0.508s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:55 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55 Sep 29 16:51:55 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:56 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb" returned: 0 in 0.334s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.789s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-743570124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78af5f83-3b6a-4c60-bcc8-d683f70cfc23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227b26e5019842b4917409135916ef30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:54Z,use_quota=True,user_id='08c05cc87d244489b4e98384dd3202b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Creating volume 78af5f83-3b6a-4c60-bcc8-d683f70cfc23 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:56 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:56 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23 1073741824 Sep 29 16:51:56 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55e7cfd-f2a3-42dd-8b58-8929f00602f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e24f189-73dc-4eaa-96f0-7ee8c34d709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:56 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb (cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb): created successfully Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e24f189-73dc-4eaa-96f0-7ee8c34d709d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Flow 'volume_create_manager' (2c64a2a7-4da5-4560-8e2e-98f2ef10cf7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:56 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-248b0bfe-23f1-4024-947a-a5d6b1cf4f55" returned: 0 in 0.316s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:56 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4836c9fa-aa38-450d-8ae4-58ff945033cc tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Created volume successfully. Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-248b0bfe-23f1-4024-947a-a5d6b1cf4f55" released by "delete_volume" :: held 0.887s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Created reservations ['c424efd6-4ca7-4299-a599-737e58e264ae', 'b22af749-8043-4adb-b542-317b1b40fd6e', 'b45ecf33-bea0-4922-bdb0-45f67a309f61', '8a4d0d8e-d5a8-4e6b-baef-bcb6b8e2cc3a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:56 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:56 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-quobyte-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4ddcca-5859-448d-86e6-d26b11152981]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:56 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:56 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31 Sep 29 16:51:56 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.342s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:56 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:56 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Deleted volume successfully. Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23 1073741824" returned: 0 in 0.590s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78130991-8330-479d-82da-fbc0731bbb0e tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-248b0bfe-23f1-4024-947a-a5d6b1cf4f55-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:56 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23 Sep 29 16:51:56 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:57 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31" returned: 0 in 0.512s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:57 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31 Sep 29 16:51:57 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:57 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23" returned: 0 in 0.417s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.486s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1854913178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=540dc5b2-c0ca-4bc2-86cf-913fac797fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='227b26e5019842b4917409135916ef30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:55Z,use_quota=True,user_id='08c05cc87d244489b4e98384dd3202b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Creating volume 540dc5b2-c0ca-4bc2-86cf-913fac797fda {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:51:57 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f75e29b-8c1d-433e-aeec-f032a48c5d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bd5dd1-8fd4-48f9-a5cf-b6ca79eba2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:57 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23 (78af5f83-3b6a-4c60-bcc8-d683f70cfc23): created successfully Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bd5dd1-8fd4-48f9-a5cf-b6ca79eba2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:57 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda 1073741824 Sep 29 16:51:57 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Flow 'volume_create_manager' (b16bfb7c-f50a-4ee0-abf6-e3c922cfc834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-cab93c69-2fc3-483e-b2c7-d5afc0519d83 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Created volume successfully. Sep 29 16:51:57 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31" returned: 0 in 0.305s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31" released by "delete_volume" :: held 0.865s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Created reservations ['c238faaf-1503-4594-95ac-0eaac4eb3c0d', '8f392db1-5acb-4e6f-9400-c042b9940d67', '7fe2df9f-7e3f-48ae-ad5d-08170e483674', '86555adc-2c39-4303-8edb-dbf650093fad'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:57 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:57 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-9203b0d0-fbc9-4a24-825d-3df4adb5a436-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-9203b0d0-fbc9-4a24-825d-3df4adb5a436-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-quobyte-9203b0d0-fbc9-4a24-825d-3df4adb5a436" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-9203b0d0-fbc9-4a24-825d-3df4adb5a436" acquired by "delete_volume" :: waited 0.034s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:57 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.346s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[30109d0d-5616-4ad3-a231-a4dc035f26c2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Deleted volume successfully. Sep 29 16:51:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-50c48ca0-79a6-4c61-bcf0-255c715c48dc tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-dd5fd6e6-f13f-42e9-81ea-d770d7bb6b31-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:58 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda 1073741824" returned: 0 in 0.755s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:58 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda Sep 29 16:51:58 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:58 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436 Sep 29 16:51:58 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:58 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda" returned: 0 in 0.311s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385377c0-cab9-49a3-8768-b007e3f3fa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5273c825-2d49-452b-b7db-317e523020f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:58 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:58 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Volume volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda (540dc5b2-c0ca-4bc2-86cf-913fac797fda): created successfully Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5273c825-2d49-452b-b7db-317e523020f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Flow 'volume_create_manager' (cb22b82f-4b2c-402b-ab75-5d5a738c4aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436" returned: 0 in 0.487s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:58 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-19d87792-0134-4b5e-ba08-ca3d8359df70 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Created volume successfully. Sep 29 16:51:58 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436 Sep 29 16:51:58 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:58 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9203b0d0-fbc9-4a24-825d-3df4adb5a436" returned: 0 in 0.266s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-9203b0d0-fbc9-4a24-825d-3df4adb5a436" released by "delete_volume" :: held 0.833s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Created reservations ['910645eb-b906-4a48-a262-53b06fab25c5', '9163ced0-22c7-46cc-a4b0-8040abbc306a', '24fef6e1-46b0-44c0-9cfd-d28ce12146ae', 'a6f3f138-9937-42c2-ab25-a694420efc29'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:58 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:51:58 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-6b48218c-6a09-473f-9a21-6560d4d38fad-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-6b48218c-6a09-473f-9a21-6560d4d38fad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-quobyte-b248ab19-0ab6-47ff-ae44-dceea3b000c0" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-b248ab19-0ab6-47ff-ae44-dceea3b000c0" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-quobyte-6b48218c-6a09-473f-9a21-6560d4d38fad" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-6b48218c-6a09-473f-9a21-6560d4d38fad" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Deleting offline snapshot 6b48218c-6a09-473f-9a21-6560d4d38fad of volume b248ab19-0ab6-47ff-ae44-dceea3b000c0 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] snapshot_file for this snap is: volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bd599d-d480-40af-b947-1d3335e2c353]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:59 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.315s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:51:59 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Deleted volume successfully. Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-90121b52-5495-4f4b-9cdf-246d7cdb48c5 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-9203b0d0-fbc9-4a24-825d-3df4adb5a436-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:51:59 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad Sep 29 16:51:59 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Flow 'volume_create_manager' (4845ee7f-033c-424c-a01e-539280941ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59826451-13ea-4951-9d61-52bf1a2f9ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "cinder-540dc5b2-c0ca-4bc2-86cf-913fac797fda-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59826451-13ea-4951-9d61-52bf1a2f9ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e694b6f-6c03-4a02-92a0-0d518e1eab45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7693218c0b944cacb23aac0a883fe7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:59Z,use_quota=True,user_id='7902745c44a442bd8ebe989299a591b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4961a4-246e-4769-b784-17ab340ee414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f4961a4-246e-4769-b784-17ab340ee414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e2172a-0065-4799-b6cd-19b9b1c48b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.image.glance [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Creating Keystone auth plugin from conf {{(pid=86793) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-540dc5b2-c0ca-4bc2-86cf-913fac797fda-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "cinder-quobyte-540dc5b2-c0ca-4bc2-86cf-913fac797fda" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-quobyte-540dc5b2-c0ca-4bc2-86cf-913fac797fda" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f29cf4-b50a-40b2-ad26-cecad744fba3]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:59 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad" returned: 0 in 0.499s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[881b0615-3907-4a8d-8b7d-87afb77177ce]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:51:59 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda Sep 29 16:51:59 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:59 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 Sep 29 16:51:59 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e2172a-0065-4799-b6cd-19b9b1c48b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e694b6f-6c03-4a02-92a0-0d518e1eab45', 'volume_name': 'volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45', 'volume_size': 1, 'image_id': '8238fc09-b312-4088-836d-4bd81695b59e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8238fc09-b312-4088-836d-4bd81695b59e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f49636b99572e21b4b17709e8ed945bc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7693218c0b944cacb23aac0a883fe7b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8fdce3eace3ad27ef512f132db7285f7c9552edda97320c9e9942eb971d62592590bd5c9715505a701421c145310260bc926ada83081b8cbe9854882d52d89be', 'id': '8238fc09-b312-4088-836d-4bd81695b59e', 'created_at': datetime.datetime(2026, 9, 29, 14, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8238fc09-b312-4088-836d-4bd81695b59e/file', 'properties': {}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd90f95-1bd2-459f-a10a-8fb3fb81f998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd90f95-1bd2-459f-a10a-8fb3fb81f998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044c02d3-e14d-4e51-8c22-fc3835e2450e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:51:59 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Volume 3e694b6f-6c03-4a02-92a0-0d518e1eab45: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45', 'volume_size': 1, 'image_id': '8238fc09-b312-4088-836d-4bd81695b59e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8238fc09-b312-4088-836d-4bd81695b59e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f49636b99572e21b4b17709e8ed945bc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7693218c0b944cacb23aac0a883fe7b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8fdce3eace3ad27ef512f132db7285f7c9552edda97320c9e9942eb971d62592590bd5c9715505a701421c145310260bc926ada83081b8cbe9854882d52d89be', 'id': '8238fc09-b312-4088-836d-4bd81695b59e', 'created_at': datetime.datetime(2026, 9, 29, 14, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8238fc09-b312-4088-836d-4bd81695b59e/file', 'properties': {}}, 'image_service': } Sep 29 16:51:59 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Trying to clone 3e694b6f-6c03-4a02-92a0-0d518e1eab45 from image 8238fc09-b312-4088-836d-4bd81695b59e at location (None, [{'url': 'file:///opt/stack/data/glance/images/8238fc09-b312-4088-836d-4bd81695b59e', 'metadata': {}}]). {{(pid=86793) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 16:52:00 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Image download 0.00 MB at 0.00 MB/s Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[55496f53-aee9-4c0a-b2b8-9c1414e1a19f]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:00 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0" returned: 0 in 0.482s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:00 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda" returned: 0 in 0.583s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:00 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad Sep 29 16:52:00 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:00 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda Sep 29 16:52:00 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:00 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD Sep 29 16:52:00 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:00 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-540dc5b2-c0ca-4bc2-86cf-913fac797fda" returned: 0 in 0.298s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:00 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-quobyte-540dc5b2-c0ca-4bc2-86cf-913fac797fda" released by "delete_volume" :: held 0.960s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Created reservations ['b00c2a82-1108-4fdd-abff-4e1c480f1148', 'ba0aa2d7-1740-4957-b9f1-b7669667bc94', '3f4df129-6b98-420e-b96e-fd05eec3abcf', 'a5878c38-9ddf-4222-8910-73b10ed016fc'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:00 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD Sep 29 16:52:00 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:00 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad" returned: 0 in 0.514s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:00 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:00 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:00 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad Sep 29 16:52:00 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:00 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Temporary image 8238fc09-b312-4088-836d-4bd81695b59e is fetched for user 7902745c44a442bd8ebe989299a591b3. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05cc217-9051-49d7-a922-bbadbe53c139]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:00 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:00 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.278s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0.6b48218c-6a09-473f-9a21-6560d4d38fad" returned: 0 in 0.265s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:00 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Deleted volume successfully. Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-6b48218c-6a09-473f-9a21-6560d4d38fad" released by "_delete_snapshot" :: held 1.938s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-25f3f0fe-fb90-4283-a06b-fe05cb27b22f tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-540dc5b2-c0ca-4bc2-86cf-913fac797fda-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-b248ab19-0ab6-47ff-ae44-dceea3b000c0" released by "delete_snapshot" :: held 1.969s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:00 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD Sep 29 16:52:00 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:00 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Created reservations ['898af5dc-e648-4d89-8d09-2009323c6b9e', '06c7a438-3b8a-4d00-915e-e707475001c0', 'b9982602-5623-427b-8838-dcf0026daf60', 'dc2e9816-cc54-4352-a9a7-99d5375031de'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:01 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Delete snapshot completed successfully. Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd2c1ab8-51d4-4cdc-b50f-47b62884d011 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-6b48218c-6a09-473f-9a21-6560d4d38fad-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-b248ab19-0ab6-47ff-ae44-dceea3b000c0-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-b248ab19-0ab6-47ff-ae44-dceea3b000c0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "cinder-quobyte-b248ab19-0ab6-47ff-ae44-dceea3b000c0" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-b248ab19-0ab6-47ff-ae44-dceea3b000c0" acquired by "delete_volume" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5227610-6c01-435e-a58a-62c0955e7b93]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:01 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:01 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 Sep 29 16:52:01 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:01 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD Sep 29 16:52:01 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:01 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "cinder-78af5f83-3b6a-4c60-bcc8-d683f70cfc23-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e694b6f-6c03-4a02-92a0-0d518e1eab45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7693218c0b944cacb23aac0a883fe7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:51:59Z,use_quota=True,user_id='7902745c44a442bd8ebe989299a591b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Creating volume 3e694b6f-6c03-4a02-92a0-0d518e1eab45 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:52:01 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:01 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0" returned: 0 in 0.455s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:01 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 1073741824 Sep 29 16:52:01 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-78af5f83-3b6a-4c60-bcc8-d683f70cfc23-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:01 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0 Sep 29 16:52:01 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "cinder-quobyte-78af5f83-3b6a-4c60-bcc8-d683f70cfc23" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-quobyte-78af5f83-3b6a-4c60-bcc8-d683f70cfc23" acquired by "delete_volume" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb74c082-9cfd-42f9-8180-b3e4558f8398]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:01 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23 Sep 29 16:52:01 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:01 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b248ab19-0ab6-47ff-ae44-dceea3b000c0" returned: 0 in 0.282s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-quobyte-b248ab19-0ab6-47ff-ae44-dceea3b000c0" released by "delete_volume" :: held 0.808s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Created reservations ['6f29ccb9-f86b-425a-a59c-3a8c61ecdca5', '6ff835a3-3f75-4c3f-beb8-08e1ec8f54f1', '06fef930-2b0a-4416-a62e-c32b8bec22e1', '1819829e-af7f-400f-ac2f-d96152d80202'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:02 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:02 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:02 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 1073741824" returned: 0 in 0.537s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:02 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 Sep 29 16:52:02 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:02 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23" returned: 0 in 0.545s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:02 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23 Sep 29 16:52:02 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:02 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.358s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:02 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Deleted volume successfully. Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a8727550-8786-47e4-b373-5a79e383ab26 tempest-CreateVolumesFromSnapshotTest-367293029 None] Lock "cinder-b248ab19-0ab6-47ff-ae44-dceea3b000c0-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:02 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45" returned: 0 in 0.343s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Attempting download of 8238fc09-b312-4088-836d-4bd81695b59e ((None, [{'url': 'file:///opt/stack/data/glance/images/8238fc09-b312-4088-836d-4bd81695b59e', 'metadata': {}}])) to volume 3e694b6f-6c03-4a02-92a0-0d518e1eab45. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[85697d63-3478-472c-821b-740af76d797d]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8238fc09-b312-4088-836d-4bd81695b59e_evw02wwu {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:02 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-78af5f83-3b6a-4c60-bcc8-d683f70cfc23" returned: 0 in 0.371s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-quobyte-78af5f83-3b6a-4c60-bcc8-d683f70cfc23" released by "delete_volume" :: held 0.986s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:02 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8238fc09-b312-4088-836d-4bd81695b59e_evw02wwu Sep 29 16:52:02 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Created reservations ['a876dbdd-c63e-4f8e-a807-908d05519c74', '73a62e9b-d699-4982-88c2-396e1aba4e10', 'fd260642-1e12-4e77-ae61-12309e767173', '1e13339c-8e46-4350-8602-072da27c4585'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:02 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:02 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:03 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8238fc09-b312-4088-836d-4bd81695b59e_evw02wwu" returned: 0 in 0.417s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8238fc09-b312-4088-836d-4bd81695b59e_evw02wwu {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:03 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8238fc09-b312-4088-836d-4bd81695b59e_evw02wwu Sep 29 16:52:03 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:03 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.335s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:03 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:03 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Deleted volume successfully. Sep 29 16:52:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c3e19948-8d91-4ab9-9359-defb445218e0 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-78af5f83-3b6a-4c60-bcc8-d683f70cfc23-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:03 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8238fc09-b312-4088-836d-4bd81695b59e_evw02wwu" returned: 1 in 0.375s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8238fc09-b312-4088-836d-4bd81695b59e_evw02wwu' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:52:03 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8f2e16-f71b-41bd-b821-d6114d62d49c]: (4, 'raw') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:03 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD Sep 29 16:52:03 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:03 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "cinder-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:03 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD Sep 29 16:52:03 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "cinder-quobyte-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-quobyte-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb" acquired by "delete_volume" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7903b49d-aa0d-46f9-9469-df3356536acb]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:04 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb Sep 29 16:52:04 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:04 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD" returned: 1 in 0.428s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] 8238fc09-b312-4088-836d-4bd81695b59e was raw, converting to qcow2 {{(pid=86793) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:04 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 Sep 29 16:52:04 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:04 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb" returned: 0 in 0.439s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:04 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb Sep 29 16:52:04 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:04 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb" returned: 0 in 0.318s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-quobyte-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb" released by "delete_volume" :: held 0.816s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:04 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45" returned: 0 in 0.657s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8238fc09-b312-4088-836d-4bd81695b59e_e1ka7rttdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:52:04 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:04 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Created reservations ['413da659-191c-48d0-a457-b30fd461a98b', 'b5b66f56-066a-45dc-986e-e218b5cbfaa6', '8c252019-c15f-450e-9445-e53c4fcfe6bb', 'eb7daf67-28be-4e48-b413-2720e4f45c6c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:04 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 1G Sep 29 16:52:04 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:05 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:05 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "cinder-200009ba-ba02-42de-8704-e5ab419287c4-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-200009ba-ba02-42de-8704-e5ab419287c4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "cinder-quobyte-200009ba-ba02-42de-8704-e5ab419287c4" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-quobyte-200009ba-ba02-42de-8704-e5ab419287c4" acquired by "delete_volume" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4d0d07-4163-4621-aabb-8336c4215fac]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-200009ba-ba02-42de-8704-e5ab419287c4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:05 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.380s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Deleted volume successfully. Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-78bb38cd-caa3-4463-bb3a-6e79cae76bd6 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-cc1d84b1-fbb8-4d0e-940c-fbc949c86bbb-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:05 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-200009ba-ba02-42de-8704-e5ab419287c4 Sep 29 16:52:05 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:05 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 1G" returned: 0 in 0.563s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Downloaded image 8238fc09-b312-4088-836d-4bd81695b59e ((None, [{'url': 'file:///opt/stack/data/glance/images/8238fc09-b312-4088-836d-4bd81695b59e', 'metadata': {}}])) to volume 3e694b6f-6c03-4a02-92a0-0d518e1eab45 successfully. {{(pid=86793) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Temporary image 8238fc09-b312-4088-836d-4bd81695b59e for user 7902745c44a442bd8ebe989299a591b3 is deleted. {{(pid=86793) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.volume.volume_utils [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Marking volume 3e694b6f-6c03-4a02-92a0-0d518e1eab45 as bootable. {{(pid=86793) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Copying metadata from image 8238fc09-b312-4088-836d-4bd81695b59e to 3e694b6f-6c03-4a02-92a0-0d518e1eab45. {{(pid=86793) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Creating volume glance metadata for volume 3e694b6f-6c03-4a02-92a0-0d518e1eab45 backed by image 8238fc09-b312-4088-836d-4bd81695b59e with: {'image_id': '8238fc09-b312-4088-836d-4bd81695b59e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f49636b99572e21b4b17709e8ed945bc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86793) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044c02d3-e14d-4e51-8c22-fc3835e2450e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45', 'volume_size': 1, 'image_id': '8238fc09-b312-4088-836d-4bd81695b59e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8238fc09-b312-4088-836d-4bd81695b59e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f49636b99572e21b4b17709e8ed945bc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7693218c0b944cacb23aac0a883fe7b7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8fdce3eace3ad27ef512f132db7285f7c9552edda97320c9e9942eb971d62592590bd5c9715505a701421c145310260bc926ada83081b8cbe9854882d52d89be', 'id': '8238fc09-b312-4088-836d-4bd81695b59e', 'created_at': datetime.datetime(2026, 9, 29, 14, 51, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 14, 51, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8238fc09-b312-4088-836d-4bd81695b59e/file', 'properties': {}}, 'image_service': }' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3980e5-a3a8-4061-908b-af45ec47c41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:05 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Volume volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 (3e694b6f-6c03-4a02-92a0-0d518e1eab45): created successfully Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff3980e5-a3a8-4061-908b-af45ec47c41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Flow 'volume_create_manager' (4845ee7f-033c-424c-a01e-539280941ec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ee64a058-4661-4fde-a024-668142f3f334 tempest-VolumeImageDependencyTests-1971218987 None] Created volume successfully. Sep 29 16:52:05 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-200009ba-ba02-42de-8704-e5ab419287c4" returned: 0 in 0.484s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-200009ba-ba02-42de-8704-e5ab419287c4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:05 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-200009ba-ba02-42de-8704-e5ab419287c4 Sep 29 16:52:05 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Acquiring lock "cinder-3e694b6f-6c03-4a02-92a0-0d518e1eab45-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Lock "cinder-3e694b6f-6c03-4a02-92a0-0d518e1eab45-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Acquiring lock "cinder-quobyte-3e694b6f-6c03-4a02-92a0-0d518e1eab45" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Lock "cinder-quobyte-3e694b6f-6c03-4a02-92a0-0d518e1eab45" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17cec21-94ca-450c-a6b4-b3ac263b6e4a]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:06 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-200009ba-ba02-42de-8704-e5ab419287c4" returned: 0 in 0.353s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-quobyte-200009ba-ba02-42de-8704-e5ab419287c4" released by "delete_volume" :: held 0.905s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:06 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 Sep 29 16:52:06 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Created reservations ['24d71d14-479c-4b7a-b7db-728122d5b811', '35ba59f7-4ab6-49bf-ba65-d10dbf0b3c6d', '7dec6d1e-3abe-434a-a9f5-72fbae1c6403', 'd3f419cd-92d1-4485-88d4-fa0a04442741'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:06 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:06 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "cinder-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:06 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45" returned: 0 in 0.489s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "cinder-quobyte-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:06 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45 Sep 29 16:52:06 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-quobyte-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892" acquired by "delete_volume" :: waited 0.037s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d4ad79-a530-4491-a398-f7d1c1ff55e2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:06 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.449s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Deleted volume successfully. Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-436c4850-ce6e-4736-a2fd-7adf541f54a9 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-200009ba-ba02-42de-8704-e5ab419287c4-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:06 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892 Sep 29 16:52:06 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:06 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3e694b6f-6c03-4a02-92a0-0d518e1eab45" returned: 0 in 0.390s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Lock "cinder-quobyte-3e694b6f-6c03-4a02-92a0-0d518e1eab45" released by "delete_volume" :: held 0.936s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:06 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Flow 'volume_create_manager' (76db8cd4-b428-4b6d-b149-a591b414c4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aefd0327-8df9-4c51-9dc1-87833794ea50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aefd0327-8df9-4c51-9dc1-87833794ea50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-762800840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c0191a-da57-470b-bac7-c013add19f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60f35b0256a4d79aa95d7dca6313d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:07Z,use_quota=True,user_id='68f34315bc7b4641aa58860373c28a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8b532c-6d88-4a0f-bf43-0f2a48c01eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8b532c-6d88-4a0f-bf43-0f2a48c01eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfafe671-e90e-4bac-8a77-b80e5f7ba419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfafe671-e90e-4bac-8a77-b80e5f7ba419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c0191a-da57-470b-bac7-c013add19f00', 'volume_name': 'volume-a6c0191a-da57-470b-bac7-c013add19f00', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad69550-b7b9-46a7-9732-b503baca90d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad69550-b7b9-46a7-9732-b503baca90d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd52af91-7c48-4c92-abe2-c3d58455fb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:07 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Volume a6c0191a-da57-470b-bac7-c013add19f00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c0191a-da57-470b-bac7-c013add19f00', 'volume_size': 1} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-762800840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c0191a-da57-470b-bac7-c013add19f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60f35b0256a4d79aa95d7dca6313d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:07Z,use_quota=True,user_id='68f34315bc7b4641aa58860373c28a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Creating volume a6c0191a-da57-470b-bac7-c013add19f00 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:52:07 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a6c0191a-da57-470b-bac7-c013add19f00 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:07 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892" returned: 0 in 0.490s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:07 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a6c0191a-da57-470b-bac7-c013add19f00 1073741824 Sep 29 16:52:07 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:07 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892 Sep 29 16:52:07 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Created reservations ['dba8c462-eb1b-4a50-887f-434a7ae99b50', '00e51f4a-44f4-4048-bcd6-f7c9803a6d12', '06335387-ffff-491e-99e0-0f8328ec3295', 'a0aaff5b-ffc7-451a-9b63-e823daab5a17'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:07 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:07 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:07 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892" returned: 0 in 0.306s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-quobyte-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892" released by "delete_volume" :: held 0.885s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Created reservations ['455b0917-b09a-4507-aa9b-2e19f54b292e', 'b9486954-1a50-4ec1-9899-812f6586d946', '43d090ed-76fb-4289-8bc0-f5a829391796', '6eba23e4-0764-4ddc-80e8-c54f679fde2b'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:07 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.311s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:07 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Deleted volume successfully. Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-35580c74-e82c-416e-bac6-6aec8f415ad5 tempest-VolumeImageDependencyTests-1971218987 None] Lock "cinder-3e694b6f-6c03-4a02-92a0-0d518e1eab45-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:07 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a6c0191a-da57-470b-bac7-c013add19f00 1073741824" returned: 0 in 0.560s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:07 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:07 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a6c0191a-da57-470b-bac7-c013add19f00 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:07 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a6c0191a-da57-470b-bac7-c013add19f00 Sep 29 16:52:07 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:07 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.275s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:07 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:07 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Deleted volume successfully. Sep 29 16:52:08 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-cb14806d-1eb2-459a-a559-181436afd73d tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-4b86f261-cfb3-4aec-94fc-6e7d0b9e3892-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:08 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a6c0191a-da57-470b-bac7-c013add19f00" returned: 0 in 0.270s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:52:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd52af91-7c48-4c92-abe2-c3d58455fb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c0191a-da57-470b-bac7-c013add19f00', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8387500b-3039-4b04-96a6-242e3624da4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:08 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Volume volume-a6c0191a-da57-470b-bac7-c013add19f00 (a6c0191a-da57-470b-bac7-c013add19f00): created successfully Sep 29 16:52:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8387500b-3039-4b04-96a6-242e3624da4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:08 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Flow 'volume_create_manager' (76db8cd4-b428-4b6d-b149-a591b414c4c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:08 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c60e74eb-56a5-4ef7-a638-f9504f2fb71f tempest-ProjectReaderTests-1756883929 None] Created volume successfully. Sep 29 16:52:08 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "cinder-55359ac2-4d84-46c1-8fe6-90fee1826581-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:08 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-55359ac2-4d84-46c1-8fe6-90fee1826581-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:08 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "cinder-quobyte-55359ac2-4d84-46c1-8fe6-90fee1826581" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:08 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-quobyte-55359ac2-4d84-46c1-8fe6-90fee1826581" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:08 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ac86ac-3168-4495-8e11-ab23b9cdba4f]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-55359ac2-4d84-46c1-8fe6-90fee1826581 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:09 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-55359ac2-4d84-46c1-8fe6-90fee1826581 Sep 29 16:52:09 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:09 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-55359ac2-4d84-46c1-8fe6-90fee1826581" returned: 0 in 0.499s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-55359ac2-4d84-46c1-8fe6-90fee1826581 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:09 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-55359ac2-4d84-46c1-8fe6-90fee1826581 Sep 29 16:52:09 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Acquiring lock "cinder-a6c0191a-da57-470b-bac7-c013add19f00-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Lock "cinder-a6c0191a-da57-470b-bac7-c013add19f00-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Acquiring lock "cinder-quobyte-a6c0191a-da57-470b-bac7-c013add19f00" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Lock "cinder-quobyte-a6c0191a-da57-470b-bac7-c013add19f00" acquired by "delete_volume" :: waited 0.021s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:09 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-55359ac2-4d84-46c1-8fe6-90fee1826581" returned: 0 in 0.288s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[538a51c0-c81f-4d09-887c-05cc53e7ea6c]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a6c0191a-da57-470b-bac7-c013add19f00 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-quobyte-55359ac2-4d84-46c1-8fe6-90fee1826581" released by "delete_volume" :: held 0.872s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Created reservations ['213fd517-df29-4b56-88bc-0423747ae24b', 'a08932df-859a-4d3d-b8c7-155221d939dd', 'db24c4fd-a013-4f91-85ac-9e3bc572ab59', '6db491b7-250f-4eb9-9dee-bb44834cbe92'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:09 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a6c0191a-da57-470b-bac7-c013add19f00 Sep 29 16:52:09 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:09 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:09 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:10 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a6c0191a-da57-470b-bac7-c013add19f00" returned: 0 in 0.468s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a6c0191a-da57-470b-bac7-c013add19f00 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:10 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a6c0191a-da57-470b-bac7-c013add19f00 Sep 29 16:52:10 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:10 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.373s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:10 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:10 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Deleted volume successfully. Sep 29 16:52:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5bba3d0-832e-4417-b7ea-d04534393482 tempest-CreateVolumesFromSourceVolumeTest-870557359 None] Lock "cinder-55359ac2-4d84-46c1-8fe6-90fee1826581-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:10 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a6c0191a-da57-470b-bac7-c013add19f00" returned: 0 in 0.305s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Lock "cinder-quobyte-a6c0191a-da57-470b-bac7-c013add19f00" released by "delete_volume" :: held 0.844s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:10 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Created reservations ['e986a218-ba30-4b28-81c1-17b645686fe5', 'f2fc96e9-837a-41b9-b75b-cd15ec20b73c', '518f6d5e-97de-4b17-abeb-a5ce3644ce00', '28acefc6-e2ee-4d27-9d75-77e47d00fd36'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:10 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:10 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:11 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.431s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:11 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Deleted volume successfully. Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e171394b-d936-4d4d-a35f-938bd5904587 tempest-ProjectReaderTests-1756883929 None] Lock "cinder-a6c0191a-da57-470b-bac7-c013add19f00-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Flow 'volume_create_manager' (1790d89b-b46b-4ea4-aaa6-2e6ba688e6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7217af4-1a6b-4f14-9122-e10ca93125bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7217af4-1a6b-4f14-9122-e10ca93125bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-164647953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac94d03a-ff09-4c84-9268-71f385a2838f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60f35b0256a4d79aa95d7dca6313d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:11Z,use_quota=True,user_id='68f34315bc7b4641aa58860373c28a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c309616f-19d6-4299-92da-d5a0e7ca75df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c309616f-19d6-4299-92da-d5a0e7ca75df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6e978d-76e7-4a17-ba1c-af66afb5e978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6e978d-76e7-4a17-ba1c-af66afb5e978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac94d03a-ff09-4c84-9268-71f385a2838f', 'volume_name': 'volume-ac94d03a-ff09-4c84-9268-71f385a2838f', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55420d4-a725-422d-aef3-c96679944954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55420d4-a725-422d-aef3-c96679944954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a9e3572-c9ed-440b-a405-30348903e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:11 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Volume ac94d03a-ff09-4c84-9268-71f385a2838f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac94d03a-ff09-4c84-9268-71f385a2838f', 'volume_size': 1} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-164647953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac94d03a-ff09-4c84-9268-71f385a2838f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f60f35b0256a4d79aa95d7dca6313d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:11Z,use_quota=True,user_id='68f34315bc7b4641aa58860373c28a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Creating volume ac94d03a-ff09-4c84-9268-71f385a2838f {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:52:11 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:52:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac94d03a-ff09-4c84-9268-71f385a2838f 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:11 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac94d03a-ff09-4c84-9268-71f385a2838f 1073741824 Sep 29 16:52:11 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:12 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac94d03a-ff09-4c84-9268-71f385a2838f 1073741824" returned: 0 in 0.606s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac94d03a-ff09-4c84-9268-71f385a2838f {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:12 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac94d03a-ff09-4c84-9268-71f385a2838f Sep 29 16:52:12 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:12 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac94d03a-ff09-4c84-9268-71f385a2838f" returned: 0 in 0.346s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a9e3572-c9ed-440b-a405-30348903e59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac94d03a-ff09-4c84-9268-71f385a2838f', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489126f7-84f7-4f3a-8e55-494041888055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:12 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Volume volume-ac94d03a-ff09-4c84-9268-71f385a2838f (ac94d03a-ff09-4c84-9268-71f385a2838f): created successfully Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489126f7-84f7-4f3a-8e55-494041888055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Flow 'volume_create_manager' (1790d89b-b46b-4ea4-aaa6-2e6ba688e6ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:12 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-d4f54c47-a6e2-4ced-8af3-c37435f60fd3 tempest-ProjectReaderTests-1756883929 None] Created volume successfully. Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Flow 'volume_create_manager' (00c8198a-b069-4739-ba06-2cf71ba68406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfb7a92-f259-4538-8f6f-1b1e4afac7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfb7a92-f259-4538-8f6f-1b1e4afac7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed28fc9-9b14-416a-9bce-13a3457c0ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd8155929a74ccfa1fec83492d7bc3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:13Z,use_quota=True,user_id='37f93b2b89a049cca48d91db4767a59b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c39cf8-33f9-4da5-a104-181ef3090afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5c39cf8-33f9-4da5-a104-181ef3090afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b057384-84af-490f-a5e5-5f5a0e29b6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b057384-84af-490f-a5e5-5f5a0e29b6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed28fc9-9b14-416a-9bce-13a3457c0ece', 'volume_name': 'volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5c2415-2126-4390-a4c2-c9bef4a85fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5c2415-2126-4390-a4c2-c9bef4a85fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfb14c6-1494-4097-ad04-3e833d2ed4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:12 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Volume 3ed28fc9-9b14-416a-9bce-13a3457c0ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece', 'volume_size': 1} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed28fc9-9b14-416a-9bce-13a3457c0ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd8155929a74ccfa1fec83492d7bc3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:13Z,use_quota=True,user_id='37f93b2b89a049cca48d91db4767a59b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Creating volume 3ed28fc9-9b14-416a-9bce-13a3457c0ece {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:52:12 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:52:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:12 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece 1073741824 Sep 29 16:52:12 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:13 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece 1073741824" returned: 0 in 0.543s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:13 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece Sep 29 16:52:13 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Acquiring lock "cinder-ac94d03a-ff09-4c84-9268-71f385a2838f-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Lock "cinder-ac94d03a-ff09-4c84-9268-71f385a2838f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Acquiring lock "cinder-quobyte-ac94d03a-ff09-4c84-9268-71f385a2838f" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:13 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece" returned: 0 in 0.392s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Lock "cinder-quobyte-ac94d03a-ff09-4c84-9268-71f385a2838f" acquired by "delete_volume" :: waited 0.027s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bfb14c6-1494-4097-ad04-3e833d2ed4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fd6abc-00b1-4238-92c3-ad965f085cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[25446598-52c2-4ee2-8917-3f10d804b3eb]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac94d03a-ff09-4c84-9268-71f385a2838f {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:13 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Volume volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece (3ed28fc9-9b14-416a-9bce-13a3457c0ece): created successfully Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0fd6abc-00b1-4238-92c3-ad965f085cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:13 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Flow 'volume_create_manager' (00c8198a-b069-4739-ba06-2cf71ba68406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:13 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2ec8618a-068d-4d07-957d-8c7d9e390687 tempest-CinderUnicodeTest-2470206 None] Created volume successfully. Sep 29 16:52:14 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac94d03a-ff09-4c84-9268-71f385a2838f Sep 29 16:52:14 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:14 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac94d03a-ff09-4c84-9268-71f385a2838f" returned: 0 in 0.401s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac94d03a-ff09-4c84-9268-71f385a2838f {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:14 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac94d03a-ff09-4c84-9268-71f385a2838f Sep 29 16:52:14 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:14 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-ac94d03a-ff09-4c84-9268-71f385a2838f" returned: 0 in 0.269s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Lock "cinder-quobyte-ac94d03a-ff09-4c84-9268-71f385a2838f" released by "delete_volume" :: held 0.733s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Created reservations ['2a912e62-f96a-4474-acd1-ded4364a0a0d', '36401015-770c-468b-9bec-aaf3b578311e', 'dab40fb9-f554-48d1-9af7-7aa7a2bece99', '06e46b27-5fe6-47b3-a106-4634dada37f0'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (72959c1b-b479-4a6a-b7bf-76d3ef8a150f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9defb5e8-4e8a-4583-bd10-6bbfaf42878a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9defb5e8-4e8a-4583-bd10-6bbfaf42878a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278354687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33186a3-93f8-4002-a33c-a4c75328456b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:15Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037f78c3-f192-4399-95bd-05d3064ef00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:14 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:14 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037f78c3-f192-4399-95bd-05d3064ef00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0fba34-c7fa-4d22-8404-eb5f4c28bca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0fba34-c7fa-4d22-8404-eb5f4c28bca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c33186a3-93f8-4002-a33c-a4c75328456b', 'volume_name': 'volume-c33186a3-93f8-4002-a33c-a4c75328456b', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a007f978-ffc2-4823-9ebe-f97e3f7b284a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a007f978-ffc2-4823-9ebe-f97e3f7b284a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c941451-8ea9-4060-82a2-40a204f55c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:14 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Volume c33186a3-93f8-4002-a33c-a4c75328456b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c33186a3-93f8-4002-a33c-a4c75328456b', 'volume_size': 1} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278354687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33186a3-93f8-4002-a33c-a4c75328456b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:15Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Creating volume c33186a3-93f8-4002-a33c-a4c75328456b {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:52:14 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:52:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:14 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b 1073741824 Sep 29 16:52:14 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:15 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.360s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:15 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Deleted volume successfully. Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fd52f963-82de-45e5-8c8e-70c3c25edca4 tempest-ProjectReaderTests-1756883929 None] Lock "cinder-ac94d03a-ff09-4c84-9268-71f385a2838f-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:15 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b 1073741824" returned: 0 in 0.683s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:52:15 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b Sep 29 16:52:15 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Flow 'volume_create_manager' (dd201102-a5b9-41bf-87a9-930c5a465890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f545704-7280-44ac-9669-9fa0facda9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f545704-7280-44ac-9669-9fa0facda9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2090157068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13cc39c-9d79-48c2-b61f-58b6a0b6c24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd8155929a74ccfa1fec83492d7bc3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:16Z,use_quota=True,user_id='37f93b2b89a049cca48d91db4767a59b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b0382f-3861-40cd-92de-148ede7fe678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b0382f-3861-40cd-92de-148ede7fe678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be24c42b-cbe2-4f97-8837-85586043db8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be24c42b-cbe2-4f97-8837-85586043db8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e13cc39c-9d79-48c2-b61f-58b6a0b6c24e', 'volume_name': 'volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f93b52-26d4-4dce-a1ff-2e045fa5ba71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f93b52-26d4-4dce-a1ff-2e045fa5ba71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95ee2aa-6f4e-4a68-b273-db0c899fc0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:15 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Volume e13cc39c-9d79-48c2-b61f-58b6a0b6c24e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e', 'volume_size': 1} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:15 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b" returned: 0 in 0.313s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.176s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2090157068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13cc39c-9d79-48c2-b61f-58b6a0b6c24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd8155929a74ccfa1fec83492d7bc3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:16Z,use_quota=True,user_id='37f93b2b89a049cca48d91db4767a59b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Creating volume e13cc39c-9d79-48c2-b61f-58b6a0b6c24e {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:52:15 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c941451-8ea9-4060-82a2-40a204f55c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c33186a3-93f8-4002-a33c-a4c75328456b', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:15 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e 1073741824 Sep 29 16:52:15 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04108445-deb0-4d0f-91ea-9fffe3dfccc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:15 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Volume volume-c33186a3-93f8-4002-a33c-a4c75328456b (c33186a3-93f8-4002-a33c-a4c75328456b): created successfully Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04108445-deb0-4d0f-91ea-9fffe3dfccc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:15 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (72959c1b-b479-4a6a-b7bf-76d3ef8a150f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:16 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-8f3ff31d-484d-4788-90f9-809b475bdd0d tempest-ProjectMemberTests-43856404 None] Created volume successfully. Sep 29 16:52:16 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e 1073741824" returned: 0 in 0.525s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:16 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e Sep 29 16:52:16 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:16 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e" returned: 0 in 0.299s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:16 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:52:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95ee2aa-6f4e-4a68-b273-db0c899fc0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2ab89b-d291-458b-90c9-5bb252ce6238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:16 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Volume volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e (e13cc39c-9d79-48c2-b61f-58b6a0b6c24e): created successfully Sep 29 16:52:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2ab89b-d291-458b-90c9-5bb252ce6238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:16 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Flow 'volume_create_manager' (dd201102-a5b9-41bf-87a9-930c5a465890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:16 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-342ed65a-8ef4-44f3-af5e-e60179b40072 tempest-CinderUnicodeTest-2470206 None] Created volume successfully. Sep 29 16:52:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] Creating offline snapshot 1148216e-c89f-455a-9764-0c707f772487 of volume c33186a3-93f8-4002-a33c-a4c75328456b {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:52:17 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[573dea12-ba75-4456-96e7-9f27cfec9bdc]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:17 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b Sep 29 16:52:17 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:17 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b" returned: 0 in 0.450s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:17 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 1G Sep 29 16:52:17 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:18 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=208,cinder:UPDATE=290,cinder:INSERT=72,cinder:DELETE=21 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:52:18 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=192,cinder:UPDATE=271,cinder:INSERT=75,cinder:DELETE=30 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:52:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:18 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 1G" returned: 0 in 0.498s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33186a3-93f8-4002-a33c-a4c75328456b -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:18 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33186a3-93f8-4002-a33c-a4c75328456b -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 Sep 29 16:52:18 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:18 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33186a3-93f8-4002-a33c-a4c75328456b -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487" returned: 0 in 0.408s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:18 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 is being set with open permissions: ugo+rw Sep 29 16:52:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:18 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 Sep 29 16:52:18 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:18 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487" returned: 0 in 0.317s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:19 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.info Sep 29 16:52:19 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:19 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.info" returned: 0 in 0.330s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:19 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.info is being set with open permissions: ugo+rw Sep 29 16:52:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:19 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.info Sep 29 16:52:19 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:19 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.info" returned: 0 in 0.303s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.666s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:19 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] Creating offline snapshot 2290f0a8-abd3-47d5-9cde-a24a46ef833b of volume e13cc39c-9d79-48c2-b61f-58b6a0b6c24e {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:52:19 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-58fcf266-78eb-4200-ab88-352749e877fc tempest-ProjectMemberTests-43856404 None] Create snapshot completed successfully Sep 29 16:52:19 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a095d6c-5097-43cd-a296-3e1c2736aab9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:19 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e Sep 29 16:52:19 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:20 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e" returned: 0 in 0.421s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:20 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b 1G Sep 29 16:52:20 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-1148216e-c89f-455a-9764-0c707f772487-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Lock "cinder-1148216e-c89f-455a-9764-0c707f772487-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-c33186a3-93f8-4002-a33c-a4c75328456b" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-c33186a3-93f8-4002-a33c-a4c75328456b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-1148216e-c89f-455a-9764-0c707f772487" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-1148216e-c89f-455a-9764-0c707f772487" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Deleting offline snapshot 1148216e-c89f-455a-9764-0c707f772487 of volume c33186a3-93f8-4002-a33c-a4c75328456b {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:52:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] snapshot_file for this snap is: volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:52:20 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9661ef-cffc-4a68-bc95-75d02b3333ac]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:20 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 Sep 29 16:52:20 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:20 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b 1G" returned: 0 in 0.544s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:20 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b Sep 29 16:52:20 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:21 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487" returned: 0 in 0.513s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c33186a3-93f8-4002-a33c-a4c75328456b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:52:21 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ffffad-f1ad-43a7-941f-9feffedc829f]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:21 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b" returned: 0 in 0.390s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:21 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b is being set with open permissions: ugo+rw Sep 29 16:52:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:21 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b Sep 29 16:52:21 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:21 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b Sep 29 16:52:21 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:21 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b" returned: 0 in 0.313s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:21 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.info Sep 29 16:52:21 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:21 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b" returned: 0 in 0.491s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:21 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 Sep 29 16:52:21 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:21 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.info" returned: 0 in 0.313s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:21 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.info is being set with open permissions: ugo+rw Sep 29 16:52:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:21 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.info Sep 29 16:52:21 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:22 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487" returned: 0 in 0.463s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:22 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487 Sep 29 16:52:22 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:22 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.info" returned: 0 in 0.341s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:22 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-acc9ad62-eb99-4b83-9187-c0b316dccde3 tempest-CinderUnicodeTest-2470206 None] Create snapshot completed successfully Sep 29 16:52:22 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b.1148216e-c89f-455a-9764-0c707f772487" returned: 0 in 0.377s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:22 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-1148216e-c89f-455a-9764-0c707f772487" released by "_delete_snapshot" :: held 1.997s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:22 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-c33186a3-93f8-4002-a33c-a4c75328456b" released by "delete_snapshot" :: held 2.027s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:22 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Created reservations ['a3453b37-8035-4b4e-92f7-f15a47fa359e', 'c4645264-9d46-4471-b946-d1515f676513', 'c3c89f6b-5fab-410d-8337-b7226e394ad7', '3344851f-01c8-40f7-9294-ad891927489b'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:22 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Delete snapshot completed successfully. Sep 29 16:52:22 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-3bb01526-2bac-4757-96f1-79a161684b39 tempest-ProjectMemberTests-43856404 None] Lock "cinder-1148216e-c89f-455a-9764-0c707f772487-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Acquiring lock "cinder-2290f0a8-abd3-47d5-9cde-a24a46ef833b-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Lock "cinder-2290f0a8-abd3-47d5-9cde-a24a46ef833b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Acquiring lock "cinder-quobyte-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Lock "cinder-quobyte-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Acquiring lock "cinder-quobyte-2290f0a8-abd3-47d5-9cde-a24a46ef833b" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Lock "cinder-quobyte-2290f0a8-abd3-47d5-9cde-a24a46ef833b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Deleting offline snapshot 2290f0a8-abd3-47d5-9cde-a24a46ef833b of volume e13cc39c-9d79-48c2-b61f-58b6a0b6c24e {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] snapshot_file for this snap is: volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a842ea9-3fc8-4df2-8825-410d3f39b042]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:23 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b Sep 29 16:52:23 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-c33186a3-93f8-4002-a33c-a4c75328456b-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Lock "cinder-c33186a3-93f8-4002-a33c-a4c75328456b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-c33186a3-93f8-4002-a33c-a4c75328456b" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-c33186a3-93f8-4002-a33c-a4c75328456b" acquired by "delete_volume" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbd5be4-c599-4f0f-8d81-9230b582c496]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:24 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b" returned: 0 in 0.559s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44316b1-fcf3-4f78-a1e0-a3262bd818fd]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:24 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b Sep 29 16:52:24 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:24 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e Sep 29 16:52:24 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:24 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b" returned: 0 in 0.485s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:24 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b Sep 29 16:52:24 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:24 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e" returned: 0 in 0.443s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:24 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b Sep 29 16:52:24 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:24 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-c33186a3-93f8-4002-a33c-a4c75328456b" returned: 0 in 0.310s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-c33186a3-93f8-4002-a33c-a4c75328456b" released by "delete_volume" :: held 0.889s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Created reservations ['5b5095fd-8c28-4136-85d8-d768296eee99', 'd2802373-2198-430d-9f6e-3e0df58ee111', '63078bf5-233f-4967-8eee-cbf7eaaa41c7', '155b1158-1287-4a61-a0ba-c3125fb485f4'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:24 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:24 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:25 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b" returned: 0 in 0.628s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:25 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b Sep 29 16:52:25 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:25 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.445s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:25 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Deleted volume successfully. Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-d2b857a0-7bee-46d6-af41-6b3eacc6929f tempest-ProjectMemberTests-43856404 None] Lock "cinder-c33186a3-93f8-4002-a33c-a4c75328456b-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:25 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e.2290f0a8-abd3-47d5-9cde-a24a46ef833b" returned: 0 in 0.399s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Lock "cinder-quobyte-2290f0a8-abd3-47d5-9cde-a24a46ef833b" released by "_delete_snapshot" :: held 2.189s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Lock "cinder-quobyte-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e" released by "delete_snapshot" :: held 2.233s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (0907170c-e74c-4805-b944-1ef0d7f7f5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b72f6cb-aa7c-4429-8b63-af01aa148d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b72f6cb-aa7c-4429-8b63-af01aa148d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288507591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce9fe6b-59b8-4194-af24-3bc9eebb1f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:26Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a56c19b-f036-45d6-990d-b4dcdffd6382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a56c19b-f036-45d6-990d-b4dcdffd6382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084543f9-f424-44da-b492-001d6ba7ad05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084543f9-f424-44da-b492-001d6ba7ad05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce9fe6b-59b8-4194-af24-3bc9eebb1f70', 'volume_name': 'volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defa9f33-7430-48a0-94e7-62ad77f85af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (defa9f33-7430-48a0-94e7-62ad77f85af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1edf5fef-a63d-4582-b431-0133266c7688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:25 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Volume bce9fe6b-59b8-4194-af24-3bc9eebb1f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70', 'volume_size': 1} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288507591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bce9fe6b-59b8-4194-af24-3bc9eebb1f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:26Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Creating volume bce9fe6b-59b8-4194-af24-3bc9eebb1f70 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:52:25 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:25 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Created reservations ['81291e3a-0aea-42da-98b8-cbbd3fac713b', '9bea2e2e-5306-4217-a49e-01e6ef391ef7', '82cea3bd-09b4-498c-8549-8a082067760b', 'd561c69e-23d2-4edb-baf1-d24d58f04549'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:25 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 1073741824 Sep 29 16:52:25 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:26 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Delete snapshot completed successfully. Sep 29 16:52:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-1da48873-d6ee-42c0-8871-d85a49f092e7 tempest-CinderUnicodeTest-2470206 None] Lock "cinder-2290f0a8-abd3-47d5-9cde-a24a46ef833b-delete_snapshot" released by "delete_snapshot" :: held 2.668s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:26 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 1073741824" returned: 0 in 0.619s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:26 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 Sep 29 16:52:26 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Acquiring lock "cinder-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Lock "cinder-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Acquiring lock "cinder-quobyte-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Lock "cinder-quobyte-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e" acquired by "delete_volume" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:26 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70" returned: 0 in 0.397s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:52:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1edf5fef-a63d-4582-b431-0133266c7688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:26 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11bf93d-3fbf-4d49-90f4-70c0e370c1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:26 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca50461-74ce-41ef-9911-86ee66cbd9f9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:27 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Volume volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 (bce9fe6b-59b8-4194-af24-3bc9eebb1f70): created successfully Sep 29 16:52:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11bf93d-3fbf-4d49-90f4-70c0e370c1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (0907170c-e74c-4805-b944-1ef0d7f7f5f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:27 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-822012a0-9b88-4aac-a311-eeb688702a53 tempest-ProjectMemberTests-43856404 None] Created volume successfully. Sep 29 16:52:27 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e Sep 29 16:52:27 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:27 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e" returned: 0 in 0.490s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:27 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e Sep 29 16:52:27 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:27 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e" returned: 0 in 0.352s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Lock "cinder-quobyte-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e" released by "delete_volume" :: held 0.994s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:27 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Created reservations ['6852bd36-d493-4bb6-bf48-3656deacc8ec', '2fbe2013-0d62-4aeb-87c7-78259e524a6b', '46f726bc-9403-426c-ae9c-087bdbab0eb6', '2bbe6afc-9c65-40a6-a303-6ecb4ff64113'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] Creating offline snapshot 1159a77c-8c1f-4116-80c3-3423bbcc78a7 of volume bce9fe6b-59b8-4194-af24-3bc9eebb1f70 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:52:28 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:28 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf676ecf-f779-4e99-998a-7dc5a2e83737]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:28 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 Sep 29 16:52:28 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:28 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.358s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:28 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Deleted volume successfully. Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5de82354-055b-4e3f-a07a-14d96346189e tempest-CinderUnicodeTest-2470206 None] Lock "cinder-e13cc39c-9d79-48c2-b61f-58b6a0b6c24e-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:28 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70" returned: 0 in 0.443s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:28 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 1G Sep 29 16:52:28 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Acquiring lock "cinder-3ed28fc9-9b14-416a-9bce-13a3457c0ece-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Lock "cinder-3ed28fc9-9b14-416a-9bce-13a3457c0ece-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Acquiring lock "cinder-quobyte-3ed28fc9-9b14-416a-9bce-13a3457c0ece" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Lock "cinder-quobyte-3ed28fc9-9b14-416a-9bce-13a3457c0ece" acquired by "delete_volume" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:29 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 1G" returned: 0 in 0.508s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:29 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee259122-3aca-406c-958d-0769a36bd3ce]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:29 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 Sep 29 16:52:29 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:29 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece Sep 29 16:52:29 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:29 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7" returned: 0 in 0.393s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:29 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 is being set with open permissions: ugo+rw Sep 29 16:52:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:29 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 Sep 29 16:52:29 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:29 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece" returned: 0 in 0.501s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:29 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece Sep 29 16:52:29 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:29 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7" returned: 0 in 0.291s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:29 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.info Sep 29 16:52:29 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:30 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3ed28fc9-9b14-416a-9bce-13a3457c0ece" returned: 0 in 0.335s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Lock "cinder-quobyte-3ed28fc9-9b14-416a-9bce-13a3457c0ece" released by "delete_volume" :: held 0.893s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Created reservations ['8e47b54a-14ee-4bac-8259-9c64fda56750', '743c093f-8c83-473d-8d4d-bb6da9cfb06d', '63be4dfb-93cb-413c-882f-7998f30c029f', 'dfe580b3-49c8-481a-a63b-82ab65661959'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:30 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:30 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:30 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.info" returned: 0 in 0.366s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:30 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.info is being set with open permissions: ugo+rw Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:30 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.info Sep 29 16:52:30 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:30 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:30 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.474s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.info" returned: 0 in 0.413s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.579s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:30 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Deleted volume successfully. Sep 29 16:52:30 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b98057da-8c45-43df-8248-4141a9c828bf tempest-CinderUnicodeTest-2470206 None] Lock "cinder-3ed28fc9-9b14-416a-9bce-13a3457c0ece-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:30 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-8196cf53-55f6-4571-bedd-6ab52a68656f tempest-ProjectMemberTests-43856404 None] Create snapshot completed successfully Sep 29 16:52:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-1159a77c-8c1f-4116-80c3-3423bbcc78a7-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Lock "cinder-1159a77c-8c1f-4116-80c3-3423bbcc78a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-bce9fe6b-59b8-4194-af24-3bc9eebb1f70" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-bce9fe6b-59b8-4194-af24-3bc9eebb1f70" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-1159a77c-8c1f-4116-80c3-3423bbcc78a7" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-1159a77c-8c1f-4116-80c3-3423bbcc78a7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Deleting offline snapshot 1159a77c-8c1f-4116-80c3-3423bbcc78a7 of volume bce9fe6b-59b8-4194-af24-3bc9eebb1f70 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:52:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] snapshot_file for this snap is: volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:52:31 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c2c30d-2b79-4859-9333-48dda1a8b5c0]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:31 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 Sep 29 16:52:31 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:31 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7" returned: 0 in 0.509s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:52:32 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a08e8d-8843-4f31-bd47-7c530f2be195]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:32 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 Sep 29 16:52:32 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:32 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70" returned: 0 in 0.473s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:32 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 Sep 29 16:52:32 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:32 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7" returned: 0 in 0.436s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:32 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7 Sep 29 16:52:32 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:33 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70.1159a77c-8c1f-4116-80c3-3423bbcc78a7" returned: 0 in 0.305s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-1159a77c-8c1f-4116-80c3-3423bbcc78a7" released by "_delete_snapshot" :: held 1.886s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-bce9fe6b-59b8-4194-af24-3bc9eebb1f70" released by "delete_snapshot" :: held 1.921s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:33 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Created reservations ['3af3a6dc-f4b2-404a-96a9-b43f77a713fb', 'b39a312e-5126-4300-9376-f7f75225e295', '2ae7cd7c-90dd-4451-8bfe-267bd001e5b6', 'fdfd332c-1e64-4685-94f4-3b71ba6104a4'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:33 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Delete snapshot completed successfully. Sep 29 16:52:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-52a4e050-3d60-4c0b-90fd-a18a9667311c tempest-ProjectMemberTests-43856404 None] Lock "cinder-1159a77c-8c1f-4116-80c3-3423bbcc78a7-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-bce9fe6b-59b8-4194-af24-3bc9eebb1f70-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Lock "cinder-bce9fe6b-59b8-4194-af24-3bc9eebb1f70-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-bce9fe6b-59b8-4194-af24-3bc9eebb1f70" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-bce9fe6b-59b8-4194-af24-3bc9eebb1f70" acquired by "delete_volume" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:33 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0221af96-4fb5-4807-a760-f6ecd15a1cf2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:33 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 Sep 29 16:52:33 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:34 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70" returned: 0 in 0.396s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:34 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70 Sep 29 16:52:34 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:34 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bce9fe6b-59b8-4194-af24-3bc9eebb1f70" returned: 0 in 0.327s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-bce9fe6b-59b8-4194-af24-3bc9eebb1f70" released by "delete_volume" :: held 0.815s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Created reservations ['b7f6d080-8831-4e18-a020-22fd8f09494a', 'fe1c447c-947e-478a-a91e-c6fd80155e9b', '75162829-7466-498d-9c08-6c130348dd21', 'bbb27833-3cc9-47db-8196-5cfe053aad41'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:34 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:34 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:34 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:34 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:34 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.319s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:35 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Deleted volume successfully. Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-fcfa9857-9972-406b-a500-bcadaffd20a4 tempest-ProjectMemberTests-43856404 None] Lock "cinder-bce9fe6b-59b8-4194-af24-3bc9eebb1f70-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:35 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.358s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b3f14820-f4aa-49cb-b146-8b2ae88623b5 tempest-ProjectAdminTests-1638704239 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.01070022583, 'free_capacity_gb': 1775.01070022583, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86793) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (c00d16ee-57a2-4d29-a95f-e3d0c163269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36b2867-e3df-4e8d-a0ab-90bd2dab034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36b2867-e3df-4e8d-a0ab-90bd2dab034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-613162763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:35Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e42c3e7-d5dd-42c9-99eb-334e904403ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e42c3e7-d5dd-42c9-99eb-334e904403ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ea3a6f-3e05-4a17-b1b3-8a3377ad45f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ea3a6f-3e05-4a17-b1b3-8a3377ad45f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2', 'volume_name': 'volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c674e7-079c-4e1f-9834-1e2440b84784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c674e7-079c-4e1f-9834-1e2440b84784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b228ed4b-93a5-4511-924d-9a6c7600b835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:35 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Volume 2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2', 'volume_size': 1} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-613162763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:35Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Creating volume 2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:52:35 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:52:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:35 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 1073741824 Sep 29 16:52:35 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:36 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 1073741824" returned: 0 in 0.544s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:36 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 Sep 29 16:52:36 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:36 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2" returned: 0 in 0.328s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:36 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:52:36 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b228ed4b-93a5-4511-924d-9a6c7600b835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a62bec9-28f8-42ef-86a0-d52f73ded2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:36 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Volume volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 (2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2): created successfully Sep 29 16:52:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a62bec9-28f8-42ef-86a0-d52f73ded2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:36 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (c00d16ee-57a2-4d29-a95f-e3d0c163269f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:36 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-abbd03ae-cd4f-4aff-a81e-ff577c867b35 tempest-ProjectMemberTests-43856404 None] Created volume successfully. Sep 29 16:52:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:37 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] Creating offline snapshot 8708e07b-c594-4c22-befb-234df526178b of volume 2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:52:37 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[40add8b2-2b49-49bd-8d8a-409ce3714efb]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:37 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:38 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 Sep 29 16:52:38 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:38 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2" returned: 0 in 0.516s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:38 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b 1G Sep 29 16:52:38 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:39 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b 1G" returned: 0 in 0.609s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:39 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b Sep 29 16:52:39 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:39 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b" returned: 0 in 0.400s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:39 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b is being set with open permissions: ugo+rw Sep 29 16:52:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:39 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b Sep 29 16:52:39 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:39 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b" returned: 0 in 0.345s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:39 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.info Sep 29 16:52:39 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:40 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.info" returned: 0 in 0.285s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:40 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.info is being set with open permissions: ugo+rw Sep 29 16:52:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:40 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.info Sep 29 16:52:40 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:40 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.info" returned: 0 in 0.314s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.585s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:40 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ea4b3a04-3085-4cf7-bed2-b42055fdda01 tempest-ProjectMemberTests-43856404 None] Create snapshot completed successfully Sep 29 16:52:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-8708e07b-c594-4c22-befb-234df526178b-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Lock "cinder-8708e07b-c594-4c22-befb-234df526178b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-8708e07b-c594-4c22-befb-234df526178b" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-8708e07b-c594-4c22-befb-234df526178b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Deleting offline snapshot 8708e07b-c594-4c22-befb-234df526178b of volume 2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:52:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] snapshot_file for this snap is: volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:52:41 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a044065-93b9-4e68-a0c4-52ba33735649]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:41 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b Sep 29 16:52:41 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:41 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b" returned: 0 in 0.389s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:52:41 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dd1a44-ef08-4e87-a60a-1ec0e65a5255]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:41 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 Sep 29 16:52:41 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:42 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2" returned: 0 in 0.519s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:42 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b Sep 29 16:52:42 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:42 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b" returned: 0 in 0.470s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:42 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b Sep 29 16:52:42 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:42 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2.8708e07b-c594-4c22-befb-234df526178b" returned: 0 in 0.312s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-8708e07b-c594-4c22-befb-234df526178b" released by "_delete_snapshot" :: held 1.832s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:42 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2" released by "delete_snapshot" :: held 1.865s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Created reservations ['05466b61-41f7-4eff-92d1-86607c493647', 'e3e708f2-3a2a-44df-a198-27559c62f516', '95726517-d6e6-4213-bf65-443c8c7ff979', '481a424d-b0d4-41cd-bdc2-139f37534702'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:43 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Delete snapshot completed successfully. Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-687d44e2-8020-467e-bfb0-245248de7f9b tempest-ProjectMemberTests-43856404 None] Lock "cinder-8708e07b-c594-4c22-befb-234df526178b-delete_snapshot" released by "delete_snapshot" :: held 2.015s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Flow 'volume_create_manager' (35c95013-bcb0-4f71-b615-f91254523393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7612d33d-4836-4dad-9044-849c9afc1361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7612d33d-4836-4dad-9044-849c9afc1361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2107542244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658475d4-6b85-4861-a98b-d9a237b45164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a986d03472a748e79334655981c4c201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:43Z,use_quota=True,user_id='4db71014c78e41e48ebc668514391990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4a89be-050d-4c04-b4a9-713666999b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4a89be-050d-4c04-b4a9-713666999b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1626ea07-d785-4cb2-9059-104f6a028760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1626ea07-d785-4cb2-9059-104f6a028760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '658475d4-6b85-4861-a98b-d9a237b45164', 'volume_name': 'volume-658475d4-6b85-4861-a98b-d9a237b45164', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbca05f-5b39-48eb-a1f0-59e6d1ece146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbca05f-5b39-48eb-a1f0-59e6d1ece146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ef7fb4-cb9c-4966-834f-f509fbcd7584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:43 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Volume 658475d4-6b85-4861-a98b-d9a237b45164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-658475d4-6b85-4861-a98b-d9a237b45164', 'volume_size': 1} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2107542244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658475d4-6b85-4861-a98b-d9a237b45164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a986d03472a748e79334655981c4c201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:43Z,use_quota=True,user_id='4db71014c78e41e48ebc668514391990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Creating volume 658475d4-6b85-4861-a98b-d9a237b45164 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:52:43 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:43 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 1073741824 Sep 29 16:52:43 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Lock "cinder-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcd032c-604c-4120-b386-6b0519b05181]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:43 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 Sep 29 16:52:43 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:43 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 1073741824" returned: 0 in 0.503s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:43 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 Sep 29 16:52:43 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:43 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2" returned: 0 in 0.434s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:43 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2 Sep 29 16:52:43 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:44 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164" returned: 0 in 0.278s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ef7fb4-cb9c-4966-834f-f509fbcd7584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-658475d4-6b85-4861-a98b-d9a237b45164', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1eb73f-3d43-4578-acec-6b1d0a64aa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:44 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2" returned: 0 in 0.276s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:44 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Volume volume-658475d4-6b85-4861-a98b-d9a237b45164 (658475d4-6b85-4861-a98b-d9a237b45164): created successfully Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c1eb73f-3d43-4578-acec-6b1d0a64aa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Flow 'volume_create_manager' (35c95013-bcb0-4f71-b615-f91254523393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2" released by "delete_volume" :: held 0.798s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:44 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-649f5682-93b7-4059-a901-1aab11684002 tempest-SnapshotDependencyTests-808463038 None] Created volume successfully. Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Created reservations ['41bcac77-6277-4c22-a042-7fef0479fb1b', 'ef73d34a-1f98-4a72-8885-a904b77c27e2', '7c0d1e32-feb0-427a-9dd9-96d618b53fd2', '8d9fd835-6b22-4181-9163-57e019fea46c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:44 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:44 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:44 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.271s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:44 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Deleted volume successfully. Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a828c48e-b407-41f7-86e3-e9b8b66f4dea tempest-ProjectMemberTests-43856404 None] Lock "cinder-2f5248cf-0e9c-4aa1-a2b1-ce04307e5fa2-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (508bca00-8259-4318-8db7-95cb4f9a4497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442ff049-fb32-455b-aaa6-b3cbaee48a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:44 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442ff049-fb32-455b-aaa6-b3cbaee48a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259484760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c843c49-2c6b-4168-beef-4d8f9c02f994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:45Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e470a37f-4ebe-4ec5-90ae-c53738efc396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e470a37f-4ebe-4ec5-90ae-c53738efc396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9502151-041b-487c-9c54-2a516eee0209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9502151-041b-487c-9c54-2a516eee0209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c843c49-2c6b-4168-beef-4d8f9c02f994', 'volume_name': 'volume-6c843c49-2c6b-4168-beef-4d8f9c02f994', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ecc20b-c714-416a-982a-0a1e98963a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ecc20b-c714-416a-982a-0a1e98963a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819056b6-ce59-42c9-85b1-ca413446b1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:45 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Volume 6c843c49-2c6b-4168-beef-4d8f9c02f994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c843c49-2c6b-4168-beef-4d8f9c02f994', 'volume_size': 1} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259484760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c843c49-2c6b-4168-beef-4d8f9c02f994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:45Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Creating volume 6c843c49-2c6b-4168-beef-4d8f9c02f994 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:52:45 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:45 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 1073741824 Sep 29 16:52:45 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:45 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 1073741824" returned: 0 in 0.544s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:45 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 Sep 29 16:52:45 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:45 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994" returned: 0 in 0.250s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.357s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819056b6-ce59-42c9-85b1-ca413446b1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c843c49-2c6b-4168-beef-4d8f9c02f994', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849a251b-e317-433e-8c82-473e04face0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] Creating offline snapshot 19ee5c31-3167-45dc-8252-1bcbbb5b02af of volume 658475d4-6b85-4861-a98b-d9a237b45164 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:52:45 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Volume volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 (6c843c49-2c6b-4168-beef-4d8f9c02f994): created successfully Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849a251b-e317-433e-8c82-473e04face0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (508bca00-8259-4318-8db7-95cb4f9a4497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[88053cfd-89d7-465d-9073-d1eb2ab9895b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:45 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1fc54529-d028-4c9a-8022-8590ead3ea26 tempest-ProjectMemberTests-43856404 None] Created volume successfully. Sep 29 16:52:46 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 Sep 29 16:52:46 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:46 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164" returned: 0 in 0.353s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:46 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af 1G Sep 29 16:52:46 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:46 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af 1G" returned: 0 in 0.390s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658475d4-6b85-4861-a98b-d9a237b45164 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:46 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658475d4-6b85-4861-a98b-d9a237b45164 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af Sep 29 16:52:46 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:46 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-658475d4-6b85-4861-a98b-d9a237b45164 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af" returned: 0 in 0.293s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:46 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af is being set with open permissions: ugo+rw Sep 29 16:52:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:47 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af Sep 29 16:52:47 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:47 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af" returned: 0 in 0.255s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:47 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.info Sep 29 16:52:47 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:47 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.info" returned: 0 in 0.257s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:47 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.info is being set with open permissions: ugo+rw Sep 29 16:52:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:47 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.info Sep 29 16:52:47 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:47 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.info" returned: 0 in 0.246s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.671s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:47 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] Creating offline snapshot 379987cf-114e-46ad-9afb-2faa2b08bda1 of volume 6c843c49-2c6b-4168-beef-4d8f9c02f994 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:52:47 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-bb4a7a70-25dc-455d-b0b1-ad8f54b025e9 tempest-SnapshotDependencyTests-808463038 None] Create snapshot completed successfully Sep 29 16:52:47 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7171ad03-63bb-45c1-a076-ce1ca34dd9f5]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:47 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 Sep 29 16:52:47 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:48 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994" returned: 0 in 0.352s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:48 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 1G Sep 29 16:52:48 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:48 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 1G" returned: 0 in 0.403s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:48 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 Sep 29 16:52:48 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:48 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1" returned: 0 in 0.307s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:48 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 is being set with open permissions: ugo+rw Sep 29 16:52:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:48 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 Sep 29 16:52:48 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:49 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1" returned: 0 in 0.255s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:49 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.info Sep 29 16:52:49 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Flow 'volume_create_manager' (131bd279-1450-4c5e-a932-d0188782c08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776c115e-8041-43a8-845f-a8798490aecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776c115e-8041-43a8-845f-a8798490aecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a436641-98e8-49bd-8174-02e931b5478e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a986d03472a748e79334655981c4c201',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=19ee5c31-3167-45dc-8252-1bcbbb5b02af,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:49Z,use_quota=True,user_id='4db71014c78e41e48ebc668514391990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7bda94-9014-48cb-9d3e-bfb3712afad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7bda94-9014-48cb-9d3e-bfb3712afad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94bd0c1-7885-40e2-8a3b-9a158c6528d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94bd0c1-7885-40e2-8a3b-9a158c6528d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9a436641-98e8-49bd-8174-02e931b5478e', 'volume_name': 'volume-9a436641-98e8-49bd-8174-02e931b5478e', 'volume_size': 1, 'snapshot_id': '19ee5c31-3167-45dc-8252-1bcbbb5b02af'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1b51c7-a3fc-4111-a7a8-e4210dd7e0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1b51c7-a3fc-4111-a7a8-e4210dd7e0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f6c4c3b-f138-4259-a59e-c01a59cd394b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:49 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Volume 9a436641-98e8-49bd-8174-02e931b5478e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9a436641-98e8-49bd-8174-02e931b5478e', 'volume_size': 1, 'snapshot_id': '19ee5c31-3167-45dc-8252-1bcbbb5b02af'} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:49 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.info" returned: 0 in 0.276s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:49 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.info is being set with open permissions: ugo+rw Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:49 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.info Sep 29 16:52:49 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:49 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.info" returned: 0 in 0.244s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.391s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "cinder-quobyte-19ee5c31-3167-45dc-8252-1bcbbb5b02af-9a436641-98e8-49bd-8174-02e931b5478e" by "_create_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-quobyte-19ee5c31-3167-45dc-8252-1bcbbb5b02af-9a436641-98e8-49bd-8174-02e931b5478e" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Creating volume 9a436641-98e8-49bd-8174-02e931b5478e from snapshot 19ee5c31-3167-45dc-8252-1bcbbb5b02af {{(pid=86793) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "cinder-quobyte-9a436641-98e8-49bd-8174-02e931b5478e" by "_copy_volume_from_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:49 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-303caf73-dea5-4e76-a020-9bed19cb76b0 tempest-ProjectMemberTests-43856404 None] Create snapshot completed successfully Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-quobyte-9a436641-98e8-49bd-8174-02e931b5478e" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] snapshot: 19ee5c31-3167-45dc-8252-1bcbbb5b02af, volume: 9a436641-98e8-49bd-8174-02e931b5478e, {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c291239-c0b6-412f-b953-815b0c8f55b2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:49 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af Sep 29 16:52:49 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:50 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af" returned: 0 in 0.358s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-658475d4-6b85-4861-a98b-d9a237b45164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8a49ee-0c0d-43e2-b41f-197c6116bf31]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-379987cf-114e-46ad-9afb-2faa2b08bda1-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:50 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Lock "cinder-379987cf-114e-46ad-9afb-2faa2b08bda1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:50 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-6c843c49-2c6b-4168-beef-4d8f9c02f994" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-6c843c49-2c6b-4168-beef-4d8f9c02f994" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-379987cf-114e-46ad-9afb-2faa2b08bda1" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-379987cf-114e-46ad-9afb-2faa2b08bda1" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Deleting offline snapshot 379987cf-114e-46ad-9afb-2faa2b08bda1 of volume 6c843c49-2c6b-4168-beef-4d8f9c02f994 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] snapshot_file for this snap is: volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5c80c3-edc2-45d4-a278-75f4a44123ec]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:50 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 Sep 29 16:52:50 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:50 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164" returned: 0 in 0.380s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] will copy from snapshot at /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Creating direct copy from snapshot {{(pid=86793) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG cinder.utils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Path /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e not found in is_blk_device check {{(pid=86793) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:50 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e Sep 29 16:52:50 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:50 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1" returned: 0 in 0.370s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c843c49-2c6b-4168-beef-4d8f9c02f994(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f546c40c-a177-4a9c-b6c6-5c663cce155d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:50 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 Sep 29 16:52:50 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:51 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994" returned: 0 in 0.485s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:51 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 Sep 29 16:52:51 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:51 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1" returned: 0 in 0.599s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:51 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1 Sep 29 16:52:51 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:52 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994.379987cf-114e-46ad-9afb-2faa2b08bda1" returned: 0 in 0.497s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-379987cf-114e-46ad-9afb-2faa2b08bda1" released by "_delete_snapshot" :: held 2.098s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-6c843c49-2c6b-4168-beef-4d8f9c02f994" released by "delete_snapshot" :: held 2.122s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:52 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Created reservations ['71e7d863-3fd3-48de-8268-116921ff782a', 'bdf9db1f-5f78-46ab-a544-373a8fa18f73', '2f01232b-677c-4c2f-9030-29d156e5ad4f', 'b9e61723-822f-4c64-a588-15c6872f088e'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:52 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Delete snapshot completed successfully. Sep 29 16:52:52 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-71af4f91-a3cf-4f3b-8ebd-7ba76c27a564 tempest-ProjectMemberTests-43856404 None] Lock "cinder-379987cf-114e-46ad-9afb-2faa2b08bda1-delete_snapshot" released by "delete_snapshot" :: held 2.309s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-6c843c49-2c6b-4168-beef-4d8f9c02f994-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Lock "cinder-6c843c49-2c6b-4168-beef-4d8f9c02f994-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-6c843c49-2c6b-4168-beef-4d8f9c02f994" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:53 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-6c843c49-2c6b-4168-beef-4d8f9c02f994" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f338779-c88d-4e14-acc6-069a0bb66ace]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:53 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 Sep 29 16:52:53 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:54 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994" returned: 0 in 0.492s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:54 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994 Sep 29 16:52:54 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:54 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-6c843c49-2c6b-4168-beef-4d8f9c02f994" returned: 0 in 0.394s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:54 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-6c843c49-2c6b-4168-beef-4d8f9c02f994" released by "delete_volume" :: held 1.023s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:54 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Created reservations ['382f08b9-a3a8-4f29-9f2f-6c80685ded34', '90feb4d5-e45a-4ebf-ad07-e8f51e4853f8', 'b9df534e-d043-4494-ab76-cc8514a220b1', 'c3bb3f7e-135f-4021-9393-02e00af778d4'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:54 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:55 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:52:55 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:55 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.357s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:55 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:52:55 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Deleted volume successfully. Sep 29 16:52:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e0f9d3f0-01df-45ff-9e77-ee8b5b8035be tempest-ProjectMemberTests-43856404 None] Lock "cinder-6c843c49-2c6b-4168-beef-4d8f9c02f994-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:56 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:52:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (3dc31d0a-fa5d-4be4-9e7c-618c4605bc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9c3f3b-1213-4fe8-8e57-21b510d37d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca9c3f3b-1213-4fe8-8e57-21b510d37d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-514603750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d238690-bf59-412d-8f8b-bf676903b0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:57Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbaee57b-6051-4a1b-b671-f47b1ddece9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbaee57b-6051-4a1b-b671-f47b1ddece9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11566804-f7f4-4f00-9f56-b9a7f8c6ad37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11566804-f7f4-4f00-9f56-b9a7f8c6ad37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d238690-bf59-412d-8f8b-bf676903b0f4', 'volume_name': 'volume-9d238690-bf59-412d-8f8b-bf676903b0f4', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b063adf-cae1-4c81-a782-e0f6cf7edcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b063adf-cae1-4c81-a782-e0f6cf7edcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:56 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ad4040-faf1-4cfd-9310-f4c23f76ba09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:56 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Volume 9d238690-bf59-412d-8f8b-bf676903b0f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d238690-bf59-412d-8f8b-bf676903b0f4', 'volume_size': 1} Sep 29 16:52:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:57 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e" returned: 0 in 6.645s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG cinder.image.image_utils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Image conversion details: src /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e {{(pid=86793) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 16:52:57 devstack cinder-volume[86793]: INFO cinder.image.image_utils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Converted 1024.00 MB image at 154.07 MB/s Sep 29 16:52:57 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e is being set with open permissions: ugo+rw Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:57 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e Sep 29 16:52:57 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:57 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e" returned: 0 in 0.236s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-quobyte-9a436641-98e8-49bd-8174-02e931b5478e" released by "_copy_volume_from_snapshot" :: held 7.712s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-quobyte-19ee5c31-3167-45dc-8252-1bcbbb5b02af-9a436641-98e8-49bd-8174-02e931b5478e" released by "_create_volume_from_snapshot" :: held 7.778s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.799s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.631s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-514603750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d238690-bf59-412d-8f8b-bf676903b0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:52:57Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Creating volume 9d238690-bf59-412d-8f8b-bf676903b0f4 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:52:57 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:57 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4 1073741824 Sep 29 16:52:57 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f6c4c3b-f138-4259-a59e-c01a59cd394b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a436641-98e8-49bd-8174-02e931b5478e', 'volume_size': 1, 'snapshot_id': '19ee5c31-3167-45dc-8252-1bcbbb5b02af'}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3146cc10-6485-4471-9a95-7cdb1f4e42ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:57 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Volume volume-9a436641-98e8-49bd-8174-02e931b5478e (9a436641-98e8-49bd-8174-02e931b5478e): created successfully Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3146cc10-6485-4471-9a95-7cdb1f4e42ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Flow 'volume_create_manager' (131bd279-1450-4c5e-a932-d0188782c08a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-622adbb0-5732-4046-9833-a867387797b9 tempest-SnapshotDependencyTests-808463038 None] Created volume successfully. Sep 29 16:52:57 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4 1073741824" returned: 0 in 0.421s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:58 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4 Sep 29 16:52:58 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "cinder-19ee5c31-3167-45dc-8252-1bcbbb5b02af-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-19ee5c31-3167-45dc-8252-1bcbbb5b02af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "cinder-quobyte-658475d4-6b85-4861-a98b-d9a237b45164" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-quobyte-658475d4-6b85-4861-a98b-d9a237b45164" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "cinder-quobyte-19ee5c31-3167-45dc-8252-1bcbbb5b02af" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-quobyte-19ee5c31-3167-45dc-8252-1bcbbb5b02af" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Deleting offline snapshot 19ee5c31-3167-45dc-8252-1bcbbb5b02af of volume 658475d4-6b85-4861-a98b-d9a237b45164 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] snapshot_file for this snap is: volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbec865f-3128-4c18-a643-b006fc945e63]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:58 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4" returned: 0 in 0.253s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ad4040-faf1-4cfd-9310-f4c23f76ba09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d238690-bf59-412d-8f8b-bf676903b0f4', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:58 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c450808e-1513-40b6-810d-80946d537089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:52:58 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:58 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Volume volume-9d238690-bf59-412d-8f8b-bf676903b0f4 (9d238690-bf59-412d-8f8b-bf676903b0f4): created successfully Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c450808e-1513-40b6-810d-80946d537089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (3dc31d0a-fa5d-4be4-9e7c-618c4605bc33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:52:58 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4ba03aba-df02-468c-8482-a1c97f5678b3 tempest-ProjectMemberTests-43856404 None] Created volume successfully. Sep 29 16:52:58 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af" returned: 0 in 0.361s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-658475d4-6b85-4861-a98b-d9a237b45164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[372576b0-1a96-4805-9c9a-8e34b6bc86a9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:58 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 Sep 29 16:52:58 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] Creating offline snapshot 787ce0d3-d662-4f69-bf04-7aadf487cdbe of volume 9d238690-bf59-412d-8f8b-bf676903b0f4 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[188c8b66-f9b7-49bd-bc49-6e4ecb068564]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:52:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:59 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4 Sep 29 16:52:59 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:59 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164" returned: 0 in 0.541s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:59 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af Sep 29 16:52:59 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:59 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4" returned: 0 in 0.381s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:59 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe 1G Sep 29 16:52:59 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:59 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af" returned: 0 in 0.354s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:59 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af Sep 29 16:52:59 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:59 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164.19ee5c31-3167-45dc-8252-1bcbbb5b02af" returned: 0 in 0.265s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:59 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 29 16:52:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe 1G" returned: 0 in 0.419s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:52:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d238690-bf59-412d-8f8b-bf676903b0f4 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:52:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-quobyte-19ee5c31-3167-45dc-8252-1bcbbb5b02af" released by "_delete_snapshot" :: held 1.642s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-quobyte-658475d4-6b85-4861-a98b-d9a237b45164" released by "delete_snapshot" :: held 1.668s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:52:59 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d238690-bf59-412d-8f8b-bf676903b0f4 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe Sep 29 16:52:59 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:52:59 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Created reservations ['2a3c70ce-ab32-49d7-ba72-a6e84ff2d203', 'bb5def06-4447-4813-8491-61a9cd436294', 'ecd9d334-10f0-4b85-822e-9eba77b6ab96', 'a70a6f05-46cd-4a4a-9d3a-bd840c0597c2'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:52:59 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Delete snapshot completed successfully. Sep 29 16:52:59 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e2f4c37d-03fd-4d4c-ad85-0a71a116f49f tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-19ee5c31-3167-45dc-8252-1bcbbb5b02af-delete_snapshot" released by "delete_snapshot" :: held 1.802s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:00 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d238690-bf59-412d-8f8b-bf676903b0f4 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe" returned: 0 in 0.291s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:00 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe is being set with open permissions: ugo+rw Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:00 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe Sep 29 16:53:00 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "cinder-658475d4-6b85-4861-a98b-d9a237b45164-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-658475d4-6b85-4861-a98b-d9a237b45164-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "cinder-quobyte-658475d4-6b85-4861-a98b-d9a237b45164" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-quobyte-658475d4-6b85-4861-a98b-d9a237b45164" acquired by "delete_volume" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:00 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe" returned: 0 in 0.304s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc6850c-001b-4f1a-adc0-2864c1f16bbd]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:00 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.info Sep 29 16:53:00 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:00 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 Sep 29 16:53:00 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:00 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.info" returned: 0 in 0.253s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:00 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.info is being set with open permissions: ugo+rw Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:00 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.info Sep 29 16:53:00 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:00 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164" returned: 0 in 0.370s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:00 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164 Sep 29 16:53:00 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:00 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.info" returned: 0 in 0.263s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:00 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4fbf27a3-5ffe-43f4-bee3-a33c0a0b0a9a tempest-ProjectMemberTests-43856404 None] Create snapshot completed successfully Sep 29 16:53:00 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-658475d4-6b85-4861-a98b-d9a237b45164" returned: 0 in 0.252s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-quobyte-658475d4-6b85-4861-a98b-d9a237b45164" released by "delete_volume" :: held 0.684s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Created reservations ['28b7fb48-fd9a-4502-84d1-8426834e2ae4', '80984339-22a1-4bb4-a1e2-0877ad14f489', 'a1e4b631-1555-4df6-95e8-d7a2b58ffcb1', 'e5493b17-192b-4e35-90a3-5cdc2aca8bd6'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:01 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:53:01 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:01 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.249s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:53:01 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Deleted volume successfully. Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-094c8fe4-1375-49d6-bead-fb571cbddf80 tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-658475d4-6b85-4861-a98b-d9a237b45164-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "cinder-9a436641-98e8-49bd-8174-02e931b5478e-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-9a436641-98e8-49bd-8174-02e931b5478e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "cinder-quobyte-9a436641-98e8-49bd-8174-02e931b5478e" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-quobyte-9a436641-98e8-49bd-8174-02e931b5478e" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6630dc-1af3-4efe-a64c-142f248596b8]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:01 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e Sep 29 16:53:01 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:01 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e" returned: 0 in 0.364s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:01 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e Sep 29 16:53:01 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-787ce0d3-d662-4f69-bf04-7aadf487cdbe-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Lock "cinder-787ce0d3-d662-4f69-bf04-7aadf487cdbe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-9d238690-bf59-412d-8f8b-bf676903b0f4" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-9d238690-bf59-412d-8f8b-bf676903b0f4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-787ce0d3-d662-4f69-bf04-7aadf487cdbe" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:02 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-787ce0d3-d662-4f69-bf04-7aadf487cdbe" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Deleting offline snapshot 787ce0d3-d662-4f69-bf04-7aadf487cdbe of volume 9d238690-bf59-412d-8f8b-bf676903b0f4 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] snapshot_file for this snap is: volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9a436641-98e8-49bd-8174-02e931b5478e" returned: 0 in 0.287s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-quobyte-9a436641-98e8-49bd-8174-02e931b5478e" released by "delete_volume" :: held 0.691s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dc891c-0d7d-47fd-9c0b-063b0fda5bac]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Created reservations ['6551a326-64e1-4a4a-87b7-ca7ec7cd78e2', 'b4fe3f4d-2719-4255-b10b-b6cc23c0e06d', '4a9ff6e2-621f-4b69-9abe-903567c8d04a', '76b2eb2c-1efd-4326-8511-2c4e327d3714'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:02 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe Sep 29 16:53:02 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:02 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:53:02 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:02 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.253s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:53:02 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Deleted volume successfully. Sep 29 16:53:02 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-b386ceb0-dcfa-4196-9d59-673268099f46 tempest-SnapshotDependencyTests-808463038 None] Lock "cinder-9a436641-98e8-49bd-8174-02e931b5478e-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe" returned: 0 in 0.413s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d238690-bf59-412d-8f8b-bf676903b0f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[9959026b-e0e1-401a-9f2c-b55d538f191e]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:02 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4 Sep 29 16:53:02 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:02 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4" returned: 0 in 0.358s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:03 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe Sep 29 16:53:03 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:03 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe" returned: 0 in 0.370s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:03 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe Sep 29 16:53:03 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:03 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4.787ce0d3-d662-4f69-bf04-7aadf487cdbe" returned: 0 in 0.249s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-787ce0d3-d662-4f69-bf04-7aadf487cdbe" released by "_delete_snapshot" :: held 1.500s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-9d238690-bf59-412d-8f8b-bf676903b0f4" released by "delete_snapshot" :: held 1.524s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:03 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Created reservations ['61d0d1aa-5b48-43e1-8550-0627218cbab3', 'c2e5f201-18a9-49db-bbed-86b49c69937f', '00f60f9b-15ac-49e9-929d-2355035de425', '3f86309c-3a35-4f92-8aff-75e86c70a37b'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:03 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Delete snapshot completed successfully. Sep 29 16:53:03 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ed00e6bd-959c-4313-84fa-3fa8b61c6b43 tempest-ProjectMemberTests-43856404 None] Lock "cinder-787ce0d3-d662-4f69-bf04-7aadf487cdbe-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-9d238690-bf59-412d-8f8b-bf676903b0f4-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Lock "cinder-9d238690-bf59-412d-8f8b-bf676903b0f4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-9d238690-bf59-412d-8f8b-bf676903b0f4" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-9d238690-bf59-412d-8f8b-bf676903b0f4" acquired by "delete_volume" :: waited 0.022s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[324ec611-a8d2-45af-be13-d6c552633fe1]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:04 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4 Sep 29 16:53:04 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:04 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4" returned: 0 in 0.394s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:04 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4 Sep 29 16:53:04 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:05 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-9d238690-bf59-412d-8f8b-bf676903b0f4" returned: 0 in 0.288s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-9d238690-bf59-412d-8f8b-bf676903b0f4" released by "delete_volume" :: held 0.760s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Created reservations ['d6a492a9-8957-45a5-a4b2-b0bf44bd8477', '767062aa-0c3f-439e-ad06-e39cb9423031', '2c158a7d-6805-41f2-8b49-12c9887a3d2a', '717f9c6c-8e65-443d-8cdb-40c53412d91d'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:05 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:53:05 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:05 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.251s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:53:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Deleted volume successfully. Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-5ab3b365-f333-4409-af8f-161eb490ab52 tempest-ProjectMemberTests-43856404 None] Lock "cinder-9d238690-bf59-412d-8f8b-bf676903b0f4-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (552a4485-36f1-4061-bb3c-17a4db811c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7769fe9-cd92-4079-af97-1227776eedff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:05 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7769fe9-cd92-4079-af97-1227776eedff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-414351790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fa065a-c6cf-48b0-aee1-b40cc2a6a699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:06Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4d9186-bb2a-4b46-b79f-777bd68eca01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4d9186-bb2a-4b46-b79f-777bd68eca01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181da5ef-a6a8-4ed6-976c-e3f3f58d4018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (181da5ef-a6a8-4ed6-976c-e3f3f58d4018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26fa065a-c6cf-48b0-aee1-b40cc2a6a699', 'volume_name': 'volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5bc0543-3882-42a6-a8fe-5ae8ac216190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5bc0543-3882-42a6-a8fe-5ae8ac216190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20e8bf5-03a5-45e6-ab72-63a4123b7e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:06 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Volume 26fa065a-c6cf-48b0-aee1-b40cc2a6a699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699', 'volume_size': 1} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-414351790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fa065a-c6cf-48b0-aee1-b40cc2a6a699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:06Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Creating volume 26fa065a-c6cf-48b0-aee1-b40cc2a6a699 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:53:06 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:06 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 1073741824 Sep 29 16:53:06 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:06 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 1073741824" returned: 0 in 0.446s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:06 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 Sep 29 16:53:06 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:06 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699" returned: 0 in 0.313s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20e8bf5-03a5-45e6-ab72-63a4123b7e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189a182c-7447-45af-b439-9c94cfe269c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:06 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Volume volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 (26fa065a-c6cf-48b0-aee1-b40cc2a6a699): created successfully Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189a182c-7447-45af-b439-9c94cfe269c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (552a4485-36f1-4061-bb3c-17a4db811c55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:06 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4b70e58e-43f8-44f6-b49a-28a4461de4f3 tempest-ProjectMemberTests-43856404 None] Created volume successfully. Sep 29 16:53:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:08 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] Creating offline snapshot 169e5e34-0a20-407a-8b67-a5445a6c03a2 of volume 26fa065a-c6cf-48b0-aee1-b40cc2a6a699 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:53:08 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5d2e44-b547-484c-827d-93c4e6979e99]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:08 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 Sep 29 16:53:08 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:08 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699" returned: 0 in 0.381s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:08 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 1G Sep 29 16:53:08 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:09 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 1G" returned: 0 in 0.404s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:09 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 Sep 29 16:53:09 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:09 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2" returned: 0 in 0.319s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:09 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 is being set with open permissions: ugo+rw Sep 29 16:53:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:09 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 Sep 29 16:53:09 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:09 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2" returned: 0 in 0.245s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:09 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.info Sep 29 16:53:09 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:09 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.info" returned: 0 in 0.252s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:09 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.info is being set with open permissions: ugo+rw Sep 29 16:53:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:09 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.info Sep 29 16:53:09 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:10 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.info" returned: 0 in 0.253s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:10 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-eddc109d-2043-406c-a65f-c6e208c880cc tempest-ProjectMemberTests-43856404 None] Create snapshot completed successfully Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-169e5e34-0a20-407a-8b67-a5445a6c03a2-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Lock "cinder-169e5e34-0a20-407a-8b67-a5445a6c03a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-26fa065a-c6cf-48b0-aee1-b40cc2a6a699" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-26fa065a-c6cf-48b0-aee1-b40cc2a6a699" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-169e5e34-0a20-407a-8b67-a5445a6c03a2" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-169e5e34-0a20-407a-8b67-a5445a6c03a2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Deleting offline snapshot 169e5e34-0a20-407a-8b67-a5445a6c03a2 of volume 26fa065a-c6cf-48b0-aee1-b40cc2a6a699 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] snapshot_file for this snap is: volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[517dc7bf-6627-49c7-8240-2e4a66c68c9b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:10 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 Sep 29 16:53:10 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:10 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2" returned: 0 in 0.417s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b824a405-46bd-481b-9426-7650ce44d6ee]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:10 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 Sep 29 16:53:10 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:11 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699" returned: 0 in 0.393s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:11 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 Sep 29 16:53:11 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:11 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2" returned: 0 in 0.365s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:11 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2 Sep 29 16:53:11 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:11 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699.169e5e34-0a20-407a-8b67-a5445a6c03a2" returned: 0 in 0.277s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-169e5e34-0a20-407a-8b67-a5445a6c03a2" released by "_delete_snapshot" :: held 1.571s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-26fa065a-c6cf-48b0-aee1-b40cc2a6a699" released by "delete_snapshot" :: held 1.598s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:12 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Created reservations ['d43c8a26-85d1-481c-a600-9fe325426799', 'e3847e46-fb3b-4f5e-954c-27ca75038211', '764f1fb7-cc43-4546-a754-e29e2e430e4d', 'd1a00c6e-71b3-4274-82db-57d25261874c'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:12 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Delete snapshot completed successfully. Sep 29 16:53:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-2b25971e-e813-49b5-aabe-f5663b778a9c tempest-ProjectMemberTests-43856404 None] Lock "cinder-169e5e34-0a20-407a-8b67-a5445a6c03a2-delete_snapshot" released by "delete_snapshot" :: held 1.763s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-26fa065a-c6cf-48b0-aee1-b40cc2a6a699-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Lock "cinder-26fa065a-c6cf-48b0-aee1-b40cc2a6a699-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-26fa065a-c6cf-48b0-aee1-b40cc2a6a699" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-26fa065a-c6cf-48b0-aee1-b40cc2a6a699" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:12 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f9b1e3-6c97-4398-9082-38e236766dca]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:12 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 Sep 29 16:53:12 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:12 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699" returned: 0 in 0.370s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:13 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699 Sep 29 16:53:13 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:13 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-26fa065a-c6cf-48b0-aee1-b40cc2a6a699" returned: 0 in 0.251s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-26fa065a-c6cf-48b0-aee1-b40cc2a6a699" released by "delete_volume" :: held 0.696s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:13 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Created reservations ['ee9082a5-bc50-4920-963b-a545bc0859c9', '32752e3f-2eb6-4c45-96bd-1d7fd1616a08', 'b6b05f9e-fe68-42f2-9b31-42da85de7a56', '2ddffb98-2a01-4835-8384-889d09faa257'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:13 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:13 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:53:13 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:13 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:13 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.251s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:13 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:53:13 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Deleted volume successfully. Sep 29 16:53:13 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-01bc429e-560a-485f-9d20-31e35f8dd139 tempest-ProjectMemberTests-43856404 None] Lock "cinder-26fa065a-c6cf-48b0-aee1-b40cc2a6a699-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (ec63dbc6-1f46-4fa7-bc77-d07bc95bd0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5223f185-a777-4d26-8a90-c5a2bb1ba055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5223f185-a777-4d26-8a90-c5a2bb1ba055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-421414280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc0af45-0886-4441-a1e0-ed27d18a5c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:14Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffc568c-15bf-4037-9bf0-29687bb41169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ffc568c-15bf-4037-9bf0-29687bb41169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd7a2b5-f6aa-4e4e-ab57-e54ccc4e5034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd7a2b5-f6aa-4e4e-ab57-e54ccc4e5034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc0af45-0886-4441-a1e0-ed27d18a5c2e', 'volume_name': 'volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902f10ae-90b8-41c7-afc5-22d6bbde16e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (902f10ae-90b8-41c7-afc5-22d6bbde16e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc39e99-6bb3-4963-ad46-2211dfd6038b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:14 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Volume bbc0af45-0886-4441-a1e0-ed27d18a5c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e', 'volume_size': 1} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-421414280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc0af45-0886-4441-a1e0-ed27d18a5c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:14Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Creating volume bbc0af45-0886-4441-a1e0-ed27d18a5c2e {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:53:14 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:14 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e 1073741824 Sep 29 16:53:14 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:14 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e 1073741824" returned: 0 in 0.414s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:14 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e Sep 29 16:53:14 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:14 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e" returned: 0 in 0.243s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc39e99-6bb3-4963-ad46-2211dfd6038b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2ae45d-7aae-4084-bfae-c03ba764245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:14 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Volume volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e (bbc0af45-0886-4441-a1e0-ed27d18a5c2e): created successfully Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2ae45d-7aae-4084-bfae-c03ba764245a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:14 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (ec63dbc6-1f46-4fa7-bc77-d07bc95bd0b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:14 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-dc430cad-128d-4788-a89f-ff33ecb4bd97 tempest-ProjectMemberTests-43856404 None] Created volume successfully. Sep 29 16:53:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:15 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] Creating offline snapshot 8e95dc52-f1f8-478f-b4d6-ddd66393e6aa of volume bbc0af45-0886-4441-a1e0-ed27d18a5c2e {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:53:15 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca316551-b527-4034-9f3c-835d6f7441e6]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:15 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e Sep 29 16:53:15 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:15 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e" returned: 0 in 0.347s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:15 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:15 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa 1G Sep 29 16:53:15 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:16 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa 1G" returned: 0 in 0.380s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:16 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa Sep 29 16:53:16 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:16 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa" returned: 0 in 0.298s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:16 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa is being set with open permissions: ugo+rw Sep 29 16:53:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:16 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa Sep 29 16:53:16 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:16 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa" returned: 0 in 0.242s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:16 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.info Sep 29 16:53:16 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:16 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.info" returned: 0 in 0.250s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:16 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.info is being set with open permissions: ugo+rw Sep 29 16:53:16 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:16 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.info Sep 29 16:53:16 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:17 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.info" returned: 0 in 0.237s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:17 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e06616e4-a75e-4dd4-a1bc-88db68bfe7cd tempest-ProjectMemberTests-43856404 None] Create snapshot completed successfully Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-8e95dc52-f1f8-478f-b4d6-ddd66393e6aa-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Lock "cinder-8e95dc52-f1f8-478f-b4d6-ddd66393e6aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-bbc0af45-0886-4441-a1e0-ed27d18a5c2e" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-bbc0af45-0886-4441-a1e0-ed27d18a5c2e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-8e95dc52-f1f8-478f-b4d6-ddd66393e6aa" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-8e95dc52-f1f8-478f-b4d6-ddd66393e6aa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Deleting offline snapshot 8e95dc52-f1f8-478f-b4d6-ddd66393e6aa of volume bbc0af45-0886-4441-a1e0-ed27d18a5c2e {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] snapshot_file for this snap is: volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[922b12e7-8f2d-4e2c-bf79-90e6a57818a7]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:17 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa Sep 29 16:53:17 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:17 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa" returned: 0 in 0.357s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[433bdb3f-30e3-4504-b818-7608128d0298]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:17 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:17 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e Sep 29 16:53:17 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:18 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e" returned: 0 in 0.351s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:18 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa Sep 29 16:53:18 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:18 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa" returned: 0 in 0.333s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:18 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa Sep 29 16:53:18 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:18 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:18 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e.8e95dc52-f1f8-478f-b4d6-ddd66393e6aa" returned: 0 in 0.239s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-8e95dc52-f1f8-478f-b4d6-ddd66393e6aa" released by "_delete_snapshot" :: held 1.375s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-bbc0af45-0886-4441-a1e0-ed27d18a5c2e" released by "delete_snapshot" :: held 1.399s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:18 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=140,cinder:UPDATE=158,cinder:INSERT=44,cinder:DELETE=11 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:53:18 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=125,cinder:UPDATE=163,cinder:INSERT=45,cinder:DELETE=16 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:53:18 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Created reservations ['9693c299-08ce-4792-9eed-b68ceb4489b8', 'e0e8c98d-a0aa-4717-83c9-eb1fa91ace79', '3435de52-4899-4f0d-b4de-4982bb85bd7e', 'fce6c7a7-b100-47cb-9b7e-85f2181d8b70'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:18 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Delete snapshot completed successfully. Sep 29 16:53:18 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e7b68f5b-eb5f-478a-afef-00623d08d4d3 tempest-ProjectMemberTests-43856404 None] Lock "cinder-8e95dc52-f1f8-478f-b4d6-ddd66393e6aa-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:19 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-bbc0af45-0886-4441-a1e0-ed27d18a5c2e-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:19 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Lock "cinder-bbc0af45-0886-4441-a1e0-ed27d18a5c2e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:19 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-bbc0af45-0886-4441-a1e0-ed27d18a5c2e" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:19 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-bbc0af45-0886-4441-a1e0-ed27d18a5c2e" acquired by "delete_volume" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:19 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f211f4a1-4e20-4315-a7b9-49a85a9ee6e3]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:19 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:19 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e Sep 29 16:53:19 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:20 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e" returned: 0 in 0.356s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:20 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e Sep 29 16:53:20 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:20 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-bbc0af45-0886-4441-a1e0-ed27d18a5c2e" returned: 0 in 0.246s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-bbc0af45-0886-4441-a1e0-ed27d18a5c2e" released by "delete_volume" :: held 0.664s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:20 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Created reservations ['07dff8c9-1cae-4e31-a0f0-02a406f1340c', '806d4949-4ebe-4172-ba86-26057bc7ff37', '0b6ee422-1de7-4967-8716-cfc6db0c456d', '66f8c9a7-37c0-43de-bb4f-1a0bd776a0b4'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:20 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:20 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:53:20 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:20 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:20 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.244s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:20 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:53:20 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Deleted volume successfully. Sep 29 16:53:20 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-04985205-21b5-44c2-9b02-333a64fb4e8f tempest-ProjectMemberTests-43856404 None] Lock "cinder-bbc0af45-0886-4441-a1e0-ed27d18a5c2e-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (1be75f73-e4a5-4ec2-921f-5d13289f0b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c448193f-f8d5-4bff-b8cb-d61c1aa91124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c448193f-f8d5-4bff-b8cb-d61c1aa91124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689583048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b19569e-0d7a-4b19-833d-eb152f551a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:21Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b33304-4aba-404a-9740-5e4dd4ae1a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b33304-4aba-404a-9740-5e4dd4ae1a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2a2858-139a-4193-a357-718745f86cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2a2858-139a-4193-a357-718745f86cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b19569e-0d7a-4b19-833d-eb152f551a60', 'volume_name': 'volume-3b19569e-0d7a-4b19-833d-eb152f551a60', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc669828-2267-43d7-bbda-1c229f025c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc669828-2267-43d7-bbda-1c229f025c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a3aa45-5fd1-4d61-a07a-9057a1fc71b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:21 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Volume 3b19569e-0d7a-4b19-833d-eb152f551a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b19569e-0d7a-4b19-833d-eb152f551a60', 'volume_size': 1} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689583048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b19569e-0d7a-4b19-833d-eb152f551a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:21Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Creating volume 3b19569e-0d7a-4b19-833d-eb152f551a60 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:53:21 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:21 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60 1073741824 Sep 29 16:53:21 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:21 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60 1073741824" returned: 0 in 0.403s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:21 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60 Sep 29 16:53:21 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:21 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60" returned: 0 in 0.251s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29a3aa45-5fd1-4d61-a07a-9057a1fc71b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b19569e-0d7a-4b19-833d-eb152f551a60', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f0f6eb-7089-4f18-83be-c568c480fbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:21 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Volume volume-3b19569e-0d7a-4b19-833d-eb152f551a60 (3b19569e-0d7a-4b19-833d-eb152f551a60): created successfully Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f0f6eb-7089-4f18-83be-c568c480fbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:21 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (1be75f73-e4a5-4ec2-921f-5d13289f0b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:21 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7283870f-5788-47d9-b80d-a0e0d7dbf6e3 tempest-ProjectMemberTests-43856404 None] Created volume successfully. Sep 29 16:53:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:22 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] Creating offline snapshot 6d884844-1ddb-4bc7-8779-fb636c55d4c3 of volume 3b19569e-0d7a-4b19-833d-eb152f551a60 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:53:22 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6043f120-da64-413d-9854-a44a8b064528]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:22 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60 Sep 29 16:53:22 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:22 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60" returned: 0 in 0.343s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:22 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:22 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 1G Sep 29 16:53:22 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:23 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 1G" returned: 0 in 0.404s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b19569e-0d7a-4b19-833d-eb152f551a60 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:23 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b19569e-0d7a-4b19-833d-eb152f551a60 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 Sep 29 16:53:23 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:23 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b19569e-0d7a-4b19-833d-eb152f551a60 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3" returned: 0 in 0.293s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:23 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 is being set with open permissions: ugo+rw Sep 29 16:53:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:23 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 Sep 29 16:53:23 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:23 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3" returned: 0 in 0.240s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:23 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.info Sep 29 16:53:23 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:23 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.info" returned: 0 in 0.253s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:23 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.info is being set with open permissions: ugo+rw Sep 29 16:53:23 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:23 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.info Sep 29 16:53:23 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:24 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.info" returned: 0 in 0.235s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.852s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:24 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-5c0f2c5b-15e8-4edb-9a35-6cb4f47c472c tempest-ProjectMemberTests-43856404 None] Create snapshot completed successfully Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-6d884844-1ddb-4bc7-8779-fb636c55d4c3-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Lock "cinder-6d884844-1ddb-4bc7-8779-fb636c55d4c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-3b19569e-0d7a-4b19-833d-eb152f551a60" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-3b19569e-0d7a-4b19-833d-eb152f551a60" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-6d884844-1ddb-4bc7-8779-fb636c55d4c3" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-6d884844-1ddb-4bc7-8779-fb636c55d4c3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Deleting offline snapshot 6d884844-1ddb-4bc7-8779-fb636c55d4c3 of volume 3b19569e-0d7a-4b19-833d-eb152f551a60 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] snapshot_file for this snap is: volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc32c20-ca75-46ed-987d-7cd9fbdec5d5]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:24 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 Sep 29 16:53:24 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:24 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3" returned: 0 in 0.353s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b19569e-0d7a-4b19-833d-eb152f551a60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f48654-befc-4a48-89cb-a013a6973f6d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:25 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60 Sep 29 16:53:25 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:25 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60" returned: 0 in 0.346s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:25 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 Sep 29 16:53:25 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:25 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3" returned: 0 in 0.315s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:25 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3 Sep 29 16:53:25 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:25 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60.6d884844-1ddb-4bc7-8779-fb636c55d4c3" returned: 0 in 0.245s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-6d884844-1ddb-4bc7-8779-fb636c55d4c3" released by "_delete_snapshot" :: held 1.349s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-3b19569e-0d7a-4b19-833d-eb152f551a60" released by "delete_snapshot" :: held 1.370s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:25 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Created reservations ['175b3128-3389-4ecd-9cd2-2e3cda094910', '5ecd15e3-8d5a-4e15-94a1-3716a3a86b37', '2bfa9bcd-4986-4dfe-a487-07d9d1eba4f3', 'ce937eec-f0ff-40ab-8e05-373f2db003e6'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:25 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Delete snapshot completed successfully. Sep 29 16:53:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-06601bf9-797b-4ed0-85e2-63110321205c tempest-ProjectMemberTests-43856404 None] Lock "cinder-6d884844-1ddb-4bc7-8779-fb636c55d4c3-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-3b19569e-0d7a-4b19-833d-eb152f551a60-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Lock "cinder-3b19569e-0d7a-4b19-833d-eb152f551a60-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-3b19569e-0d7a-4b19-833d-eb152f551a60" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-3b19569e-0d7a-4b19-833d-eb152f551a60" acquired by "delete_volume" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:26 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[708e5b82-7c3a-4727-b3d4-9219787781c0]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:26 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60 Sep 29 16:53:26 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:27 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60" returned: 0 in 0.359s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:27 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60 Sep 29 16:53:27 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:27 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-3b19569e-0d7a-4b19-833d-eb152f551a60" returned: 0 in 0.240s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-3b19569e-0d7a-4b19-833d-eb152f551a60" released by "delete_volume" :: held 0.656s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:27 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Created reservations ['62fd9e79-93b1-4031-9469-7168cd61b0e0', 'f1c9f970-9dde-42dd-ae3e-3df39faccd11', 'b7f7e25b-30f1-45ad-bcaa-a3cb7a1e91c7', '3078870c-0026-4789-855e-c3081cc64192'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:27 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:53:27 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:27 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.244s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:27 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:53:27 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Deleted volume successfully. Sep 29 16:53:27 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-db543db6-894d-4990-a658-a0e2e7878a6c tempest-ProjectMemberTests-43856404 None] Lock "cinder-3b19569e-0d7a-4b19-833d-eb152f551a60-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (df1c59ca-8181-4f5d-9266-b93426ad40ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c5bd5f-b0c7-459f-8c23-03420fdd4299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c5bd5f-b0c7-459f-8c23-03420fdd4299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-453627058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:28Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a09e5a-4565-4ee9-81b2-678900d25d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a09e5a-4565-4ee9-81b2-678900d25d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11180ad2-ec7b-40c3-af01-176b5bd1cbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11180ad2-ec7b-40c3-af01-176b5bd1cbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4', 'volume_name': 'volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283aeb40-9798-4770-9165-7fa0d2d0d443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283aeb40-9798-4770-9165-7fa0d2d0d443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f99109-d8de-451e-a18c-018ae75d8857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:28 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Volume cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4', 'volume_size': 1} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-453627058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a906288e61642ac9acfbccf7e6f3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:28Z,use_quota=True,user_id='c4837ba2395d4d44adf5548672c434bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Creating volume cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:53:28 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:28 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 1073741824 Sep 29 16:53:28 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:28 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 1073741824" returned: 0 in 0.404s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:28 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 Sep 29 16:53:28 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:28 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4" returned: 0 in 0.245s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f99109-d8de-451e-a18c-018ae75d8857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170ae5ed-133b-4bea-a681-6b5704368a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:28 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Volume volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 (cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4): created successfully Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170ae5ed-133b-4bea-a681-6b5704368a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Flow 'volume_create_manager' (df1c59ca-8181-4f5d-9266-b93426ad40ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:28 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3c1e5074-665b-4368-9eee-e04afeba2df1 tempest-ProjectMemberTests-43856404 None] Created volume successfully. Sep 29 16:53:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:29 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] Creating offline snapshot 7147ecce-3a2e-4242-9ddc-567f8bb4f012 of volume cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:53:29 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84e767e-0d78-40b5-b327-13c646ee44c9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:29 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 Sep 29 16:53:29 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:29 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4" returned: 0 in 0.360s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:29 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 1G Sep 29 16:53:29 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:30 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 1G" returned: 0 in 0.381s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:30 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 Sep 29 16:53:30 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:30 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012" returned: 0 in 0.300s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:30 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 is being set with open permissions: ugo+rw Sep 29 16:53:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:30 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 Sep 29 16:53:30 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:30 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012" returned: 0 in 0.238s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:30 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.info Sep 29 16:53:30 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:30 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.info" returned: 0 in 0.244s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:30 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.info is being set with open permissions: ugo+rw Sep 29 16:53:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:30 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.info Sep 29 16:53:30 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:31 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.info" returned: 0 in 0.234s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:31 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-3a86700e-0f88-4589-9b2c-7f6770b50117 tempest-ProjectMemberTests-43856404 None] Create snapshot completed successfully Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-7147ecce-3a2e-4242-9ddc-567f8bb4f012-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Lock "cinder-7147ecce-3a2e-4242-9ddc-567f8bb4f012-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-7147ecce-3a2e-4242-9ddc-567f8bb4f012" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-7147ecce-3a2e-4242-9ddc-567f8bb4f012" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Deleting offline snapshot 7147ecce-3a2e-4242-9ddc-567f8bb4f012 of volume cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] snapshot_file for this snap is: volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8923ff9e-f0d6-4401-aa52-2f31768e7b31]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:31 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 Sep 29 16:53:31 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:31 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012" returned: 0 in 0.371s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f713562-535c-4214-ab74-f2c62dae42dc]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:32 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 Sep 29 16:53:32 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:32 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4" returned: 0 in 0.357s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:32 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 Sep 29 16:53:32 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:32 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012" returned: 0 in 0.317s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:32 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012 Sep 29 16:53:32 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:32 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4.7147ecce-3a2e-4242-9ddc-567f8bb4f012" returned: 0 in 0.253s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-7147ecce-3a2e-4242-9ddc-567f8bb4f012" released by "_delete_snapshot" :: held 1.392s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4" released by "delete_snapshot" :: held 1.412s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:32 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Created reservations ['ce4d22d7-cc6c-450c-8551-c1b57b728573', 'd2990d6b-0c80-419a-b0aa-cde49e8573a5', '6776ad56-0a49-46be-bc9e-da237290d7e2', 'aba48ce8-cdfd-400a-b979-80f8212c02eb'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:33 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Delete snapshot completed successfully. Sep 29 16:53:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-12fefc51-ec5b-44b5-a43e-c05c81b20a3d tempest-ProjectMemberTests-43856404 None] Lock "cinder-7147ecce-3a2e-4242-9ddc-567f8bb4f012-delete_snapshot" released by "delete_snapshot" :: held 1.530s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Lock "cinder-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Acquiring lock "cinder-quobyte-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4" acquired by "delete_volume" :: waited 0.013s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:33 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee31b7c-efa1-4619-9315-c6bc6cbf04dd]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:33 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 Sep 29 16:53:33 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:34 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4" returned: 0 in 0.344s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:34 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4 Sep 29 16:53:34 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:34 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4" returned: 0 in 0.243s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Lock "cinder-quobyte-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4" released by "delete_volume" :: held 0.646s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Created reservations ['19237098-5b19-454c-b7d4-8d062f1b6c9c', '09bce34e-36d3-4c1d-8b91-791a64b91e53', '651204e4-bdaf-43c9-bd77-1ece07be25d4', '6a8cef07-bce7-4f37-ac4a-9ff9c684f6a9'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:34 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:53:34 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:34 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.247s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:53:34 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Deleted volume successfully. Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0e7b697b-e749-4ceb-837c-138be4ef717b tempest-ProjectMemberTests-43856404 None] Lock "cinder-cb7a017d-5a7c-44b4-af43-bd16d6e4f2f4-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:34 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:53:34 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:35 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.255s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:53:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:53:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:53:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Flow 'volume_create_manager' (57b980bd-0b34-4980-9884-03492b6f1b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab6b2e5-902a-4fa4-8409-82bda6e2a8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab6b2e5-902a-4fa4-8409-82bda6e2a8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232856172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27db4605-0128-448e-87fe-aafb5c34ab59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6715f8f7e51043ffb62edaeca5dcc368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:38Z,use_quota=True,user_id='0b80f19b01904e71bb038e0fe2190fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0a2fca-236a-4af5-bc6d-3833f30d005c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb0a2fca-236a-4af5-bc6d-3833f30d005c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (311d0353-6954-4702-b5d5-9accd15dc73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (311d0353-6954-4702-b5d5-9accd15dc73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27db4605-0128-448e-87fe-aafb5c34ab59', 'volume_name': 'volume-27db4605-0128-448e-87fe-aafb5c34ab59', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a144f1d7-77ca-4d12-8de9-c910f43be0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a144f1d7-77ca-4d12-8de9-c910f43be0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b200cc7-e415-4602-8508-a68c498ccb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:38 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Volume 27db4605-0128-448e-87fe-aafb5c34ab59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27db4605-0128-448e-87fe-aafb5c34ab59', 'volume_size': 1} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232856172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27db4605-0128-448e-87fe-aafb5c34ab59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6715f8f7e51043ffb62edaeca5dcc368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:38Z,use_quota=True,user_id='0b80f19b01904e71bb038e0fe2190fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Creating volume 27db4605-0128-448e-87fe-aafb5c34ab59 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:53:38 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:38 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59 1073741824 Sep 29 16:53:38 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:38 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59 1073741824" returned: 0 in 0.413s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:38 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:38 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59 Sep 29 16:53:38 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:39 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59" returned: 0 in 0.240s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:53:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b200cc7-e415-4602-8508-a68c498ccb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27db4605-0128-448e-87fe-aafb5c34ab59', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7742a065-85a5-4e8f-a1eb-aaddb8c80bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:39 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Volume volume-27db4605-0128-448e-87fe-aafb5c34ab59 (27db4605-0128-448e-87fe-aafb5c34ab59): created successfully Sep 29 16:53:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7742a065-85a5-4e8f-a1eb-aaddb8c80bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:39 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Flow 'volume_create_manager' (57b980bd-0b34-4980-9884-03492b6f1b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:39 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-2c8e69c6-c6ef-4d8f-9318-3b2704e34da3 tempest-ProjectReaderTests-1074617190 None] Created volume successfully. Sep 29 16:53:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:39 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] Creating offline snapshot 45e272e6-c285-4818-94c9-3d51e144d8e9 of volume 27db4605-0128-448e-87fe-aafb5c34ab59 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:53:39 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b092353d-6e81-442c-b6c1-8f51c0ac9250]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:39 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59 Sep 29 16:53:39 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:39 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59" returned: 0 in 0.350s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:39 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:39 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 1G Sep 29 16:53:39 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:40 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 1G" returned: 0 in 0.382s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27db4605-0128-448e-87fe-aafb5c34ab59 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:40 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27db4605-0128-448e-87fe-aafb5c34ab59 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 Sep 29 16:53:40 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:40 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27db4605-0128-448e-87fe-aafb5c34ab59 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9" returned: 0 in 0.290s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:40 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 is being set with open permissions: ugo+rw Sep 29 16:53:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:40 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 Sep 29 16:53:40 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:40 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9" returned: 0 in 0.233s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:40 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:40 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.info Sep 29 16:53:40 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:41 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.info" returned: 0 in 0.246s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:41 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.info is being set with open permissions: ugo+rw Sep 29 16:53:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:41 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.info Sep 29 16:53:41 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:41 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.info" returned: 0 in 0.237s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.824s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:41 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-829812d5-c15d-4b82-b4b0-a070e6aca03c tempest-ProjectReaderTests-1074617190 None] Create snapshot completed successfully Sep 29 16:53:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-45e272e6-c285-4818-94c9-3d51e144d8e9-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-45e272e6-c285-4818-94c9-3d51e144d8e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-27db4605-0128-448e-87fe-aafb5c34ab59" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-27db4605-0128-448e-87fe-aafb5c34ab59" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-45e272e6-c285-4818-94c9-3d51e144d8e9" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:41 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-45e272e6-c285-4818-94c9-3d51e144d8e9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Deleting offline snapshot 45e272e6-c285-4818-94c9-3d51e144d8e9 of volume 27db4605-0128-448e-87fe-aafb5c34ab59 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:53:41 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] snapshot_file for this snap is: volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:53:41 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d49195-aae3-4078-bdb0-95e854b50e46]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:41 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:41 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 Sep 29 16:53:41 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:42 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9" returned: 0 in 0.351s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:42 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27db4605-0128-448e-87fe-aafb5c34ab59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:53:42 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65e2670-3869-4c64-a350-d5ab6df6be1e]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:42 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59 Sep 29 16:53:42 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:42 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59" returned: 0 in 0.345s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:42 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 Sep 29 16:53:42 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:42 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9" returned: 0 in 0.313s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:42 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:42 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9 Sep 29 16:53:42 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:43 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59.45e272e6-c285-4818-94c9-3d51e144d8e9" returned: 0 in 0.249s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-45e272e6-c285-4818-94c9-3d51e144d8e9" released by "_delete_snapshot" :: held 1.351s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-27db4605-0128-448e-87fe-aafb5c34ab59" released by "delete_snapshot" :: held 1.370s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:43 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Created reservations ['270539e6-48f2-424b-90af-72847dd5ce6f', '48cda5f7-2d77-4da5-9f28-6ad055d09cb1', '71211ee5-238e-4061-a066-5db94bb80b44', '1578d3cf-58b1-45c2-a89b-f34905b275e5'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:43 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Delete snapshot completed successfully. Sep 29 16:53:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-273e9c9a-b109-4d75-91bb-2fcecf3c6652 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-45e272e6-c285-4818-94c9-3d51e144d8e9-delete_snapshot" released by "delete_snapshot" :: held 1.497s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-27db4605-0128-448e-87fe-aafb5c34ab59-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-27db4605-0128-448e-87fe-aafb5c34ab59-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-27db4605-0128-448e-87fe-aafb5c34ab59" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:43 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-27db4605-0128-448e-87fe-aafb5c34ab59" acquired by "delete_volume" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:43 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d55e324-0fdd-4b97-9d99-24c6703f6c6d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:43 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:44 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59 Sep 29 16:53:44 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:44 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59" returned: 0 in 0.347s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:44 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59 Sep 29 16:53:44 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:44 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-27db4605-0128-448e-87fe-aafb5c34ab59" returned: 0 in 0.242s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-27db4605-0128-448e-87fe-aafb5c34ab59" released by "delete_volume" :: held 0.656s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:44 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Created reservations ['de40a3f8-be73-4154-990b-466840f26ceb', '005057d1-6426-462e-96db-3e028626607f', 'ea992e7b-01c7-4494-aaec-0d261e335655', 'efb1b526-1673-4322-b0e5-55605e380f6a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:44 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:44 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:53:44 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:44 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:44 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.239s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:44 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:53:44 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Deleted volume successfully. Sep 29 16:53:44 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-96b3616f-218a-4f61-b6b9-e657365a68f8 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-27db4605-0128-448e-87fe-aafb5c34ab59-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Flow 'volume_create_manager' (55af53ca-7820-4b7e-804b-cae1f4cc63d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b91b413-fe9a-4a8a-a95c-20ddc50462b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b91b413-fe9a-4a8a-a95c-20ddc50462b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498442843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43bea5b5-1ea6-4d2e-8d03-4a3a060549a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6715f8f7e51043ffb62edaeca5dcc368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:45Z,use_quota=True,user_id='0b80f19b01904e71bb038e0fe2190fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce158cb-226c-47a3-ab78-19e27bb8ae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce158cb-226c-47a3-ab78-19e27bb8ae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff5a1c1-6b9d-4975-8886-ef7eff0a14e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dff5a1c1-6b9d-4975-8886-ef7eff0a14e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43bea5b5-1ea6-4d2e-8d03-4a3a060549a3', 'volume_name': 'volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e74522e-4716-46d6-aa97-67994ac2dd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e74522e-4716-46d6-aa97-67994ac2dd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaffe4f2-1d72-4321-a988-f01dcaa9e170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:45 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Volume 43bea5b5-1ea6-4d2e-8d03-4a3a060549a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3', 'volume_size': 1} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498442843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43bea5b5-1ea6-4d2e-8d03-4a3a060549a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6715f8f7e51043ffb62edaeca5dcc368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:45Z,use_quota=True,user_id='0b80f19b01904e71bb038e0fe2190fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Creating volume 43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:53:45 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:45 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 1073741824 Sep 29 16:53:45 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:45 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 1073741824" returned: 0 in 0.408s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:45 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:45 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 Sep 29 16:53:45 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:46 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3" returned: 0 in 0.239s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:53:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaffe4f2-1d72-4321-a988-f01dcaa9e170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f3f754-497c-415e-bd94-e3d7aa5a2b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:46 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Volume volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 (43bea5b5-1ea6-4d2e-8d03-4a3a060549a3): created successfully Sep 29 16:53:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f3f754-497c-415e-bd94-e3d7aa5a2b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:46 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Flow 'volume_create_manager' (55af53ca-7820-4b7e-804b-cae1f4cc63d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:46 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-4cf17fbd-c6d0-4a26-9fd3-094324bd37c2 tempest-ProjectReaderTests-1074617190 None] Created volume successfully. Sep 29 16:53:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:46 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] Creating offline snapshot a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 of volume 43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:53:46 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1b7e0f-f4cc-4fd2-a2ab-2a1256ea2f4f]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:46 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 Sep 29 16:53:46 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:46 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3" returned: 0 in 0.364s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:46 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:46 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 1G Sep 29 16:53:46 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:47 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 1G" returned: 0 in 0.384s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:47 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 Sep 29 16:53:47 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:47 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531" returned: 0 in 0.276s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:47 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 is being set with open permissions: ugo+rw Sep 29 16:53:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:47 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 Sep 29 16:53:47 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:47 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531" returned: 0 in 0.241s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:47 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:47 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.info Sep 29 16:53:47 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:48 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.info" returned: 0 in 0.258s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:48 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.info is being set with open permissions: ugo+rw Sep 29 16:53:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:48 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.info Sep 29 16:53:48 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:48 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.info" returned: 0 in 0.235s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:48 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1830ef37-a1e1-4b6d-a8bc-c940fcd4446b tempest-ProjectReaderTests-1074617190 None] Create snapshot completed successfully Sep 29 16:53:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-a97125cd-5a5a-4f23-8b3f-b1cb35bb1531-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-a97125cd-5a5a-4f23-8b3f-b1cb35bb1531-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-a97125cd-5a5a-4f23-8b3f-b1cb35bb1531" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:48 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-a97125cd-5a5a-4f23-8b3f-b1cb35bb1531" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Deleting offline snapshot a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 of volume 43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:53:48 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] snapshot_file for this snap is: volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:53:48 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fc3a18-ec44-42f1-90e8-c679e75a2dd9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:48 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:48 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 Sep 29 16:53:48 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:49 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531" returned: 0 in 0.347s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:49 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:53:49 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[594df94c-c50e-4dd7-af58-4e88029fb6b0]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:49 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 Sep 29 16:53:49 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:49 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3" returned: 0 in 0.352s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:49 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 Sep 29 16:53:49 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:49 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531" returned: 0 in 0.330s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:49 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:49 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531 Sep 29 16:53:49 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:50 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3.a97125cd-5a5a-4f23-8b3f-b1cb35bb1531" returned: 0 in 0.236s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-a97125cd-5a5a-4f23-8b3f-b1cb35bb1531" released by "_delete_snapshot" :: held 1.358s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3" released by "delete_snapshot" :: held 1.380s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:50 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Created reservations ['e36de4ad-309e-447d-af5f-7a8fbd5f82a9', '8019f937-4672-421b-bc8e-3bce95292175', '0e958d3a-832e-434c-a6c4-8acbdb3f9de1', 'dae3f7d9-0a32-46a6-a7a5-6486e1aef685'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:50 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Delete snapshot completed successfully. Sep 29 16:53:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-ac9c480e-b4f1-4fa6-b240-d9acd2c332d5 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-a97125cd-5a5a-4f23-8b3f-b1cb35bb1531-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:50 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3" acquired by "delete_volume" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:50 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6aa3779-2f0c-49b3-b28e-9a28c82d452a]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:50 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:51 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 Sep 29 16:53:51 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:51 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3" returned: 0 in 0.345s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:51 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3 Sep 29 16:53:51 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:51 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3" returned: 0 in 0.248s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3" released by "delete_volume" :: held 0.651s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:51 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Created reservations ['edd69600-f7bd-4db2-834a-a59c4f307395', '29b77cd2-8c38-4ca3-abda-81de7a50bf1a', '2c945c36-b9ac-4ffd-8ff0-51ec93fb793b', 'bb718fcb-e8ff-4ad6-ba98-b916451818dd'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:51 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:51 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:53:51 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:51 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:51 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.236s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:51 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:53:51 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Deleted volume successfully. Sep 29 16:53:51 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-a33f1147-2d23-408c-b286-1516fda58189 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-43bea5b5-1ea6-4d2e-8d03-4a3a060549a3-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Flow 'volume_create_manager' (c67e2b3d-b4c0-4434-9225-0f0c0b210801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb83c34-6924-42a9-9d52-72b559aeb5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb83c34-6924-42a9-9d52-72b559aeb5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-789942501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60695393-29a2-48cb-878b-4d9690a66c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6715f8f7e51043ffb62edaeca5dcc368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:52Z,use_quota=True,user_id='0b80f19b01904e71bb038e0fe2190fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08864e75-7185-456d-93d7-e1b6d0bfb3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08864e75-7185-456d-93d7-e1b6d0bfb3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c995c841-3547-433d-8091-8642ba6ccd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c995c841-3547-433d-8091-8642ba6ccd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60695393-29a2-48cb-878b-4d9690a66c8c', 'volume_name': 'volume-60695393-29a2-48cb-878b-4d9690a66c8c', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673e38cf-4a6a-4a86-b8fc-b29353dde9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673e38cf-4a6a-4a86-b8fc-b29353dde9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15198209-b43f-452d-aada-812b277fe580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:52 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Volume 60695393-29a2-48cb-878b-4d9690a66c8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60695393-29a2-48cb-878b-4d9690a66c8c', 'volume_size': 1} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-789942501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60695393-29a2-48cb-878b-4d9690a66c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6715f8f7e51043ffb62edaeca5dcc368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:52Z,use_quota=True,user_id='0b80f19b01904e71bb038e0fe2190fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Creating volume 60695393-29a2-48cb-878b-4d9690a66c8c {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:53:52 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:52 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c 1073741824 Sep 29 16:53:52 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:52 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c 1073741824" returned: 0 in 0.399s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:52 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:52 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c Sep 29 16:53:52 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:53 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c" returned: 0 in 0.237s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:53:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15198209-b43f-452d-aada-812b277fe580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60695393-29a2-48cb-878b-4d9690a66c8c', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e567852-73b1-433c-bc18-e99da62a1761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:53 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Volume volume-60695393-29a2-48cb-878b-4d9690a66c8c (60695393-29a2-48cb-878b-4d9690a66c8c): created successfully Sep 29 16:53:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e567852-73b1-433c-bc18-e99da62a1761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:53 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Flow 'volume_create_manager' (c67e2b3d-b4c0-4434-9225-0f0c0b210801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:53 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-1b4a22b0-e794-4593-aeee-509937219866 tempest-ProjectReaderTests-1074617190 None] Created volume successfully. Sep 29 16:53:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:53 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] Creating offline snapshot a13bf139-6bd9-469e-9e0e-8c6f22b6417e of volume 60695393-29a2-48cb-878b-4d9690a66c8c {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:53:53 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf6679a-5531-4d16-8bba-d7e0c5f9f2a9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:53 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c Sep 29 16:53:53 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:53 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c" returned: 0 in 0.355s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:53 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:53 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e 1G Sep 29 16:53:53 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:54 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e 1G" returned: 0 in 0.381s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60695393-29a2-48cb-878b-4d9690a66c8c -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:54 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60695393-29a2-48cb-878b-4d9690a66c8c -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e Sep 29 16:53:54 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:54 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60695393-29a2-48cb-878b-4d9690a66c8c -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e" returned: 0 in 0.288s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:54 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e is being set with open permissions: ugo+rw Sep 29 16:53:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:54 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e Sep 29 16:53:54 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:54 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e" returned: 0 in 0.241s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:54 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:54 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.info Sep 29 16:53:54 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:55 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.info" returned: 0 in 0.240s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:55 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.info is being set with open permissions: ugo+rw Sep 29 16:53:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:55 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.info Sep 29 16:53:55 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:55 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.info" returned: 0 in 0.240s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:55 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f4c61659-a007-4319-9c04-49273371d535 tempest-ProjectReaderTests-1074617190 None] Create snapshot completed successfully Sep 29 16:53:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-a13bf139-6bd9-469e-9e0e-8c6f22b6417e-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-a13bf139-6bd9-469e-9e0e-8c6f22b6417e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-60695393-29a2-48cb-878b-4d9690a66c8c" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-60695393-29a2-48cb-878b-4d9690a66c8c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-a13bf139-6bd9-469e-9e0e-8c6f22b6417e" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:55 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-a13bf139-6bd9-469e-9e0e-8c6f22b6417e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Deleting offline snapshot a13bf139-6bd9-469e-9e0e-8c6f22b6417e of volume 60695393-29a2-48cb-878b-4d9690a66c8c {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:53:55 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] snapshot_file for this snap is: volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:53:55 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[201db15e-e843-476e-a9eb-64798d20d424]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:55 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:55 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e Sep 29 16:53:55 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:56 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e" returned: 0 in 0.351s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:56 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60695393-29a2-48cb-878b-4d9690a66c8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:53:56 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[8befadf5-59c1-43d8-9df0-55b8757d580d]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:56 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c Sep 29 16:53:56 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:56 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c" returned: 0 in 0.351s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:56 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e Sep 29 16:53:56 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:56 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e" returned: 0 in 0.332s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:56 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:56 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e Sep 29 16:53:56 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:57 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c.a13bf139-6bd9-469e-9e0e-8c6f22b6417e" returned: 0 in 0.242s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-a13bf139-6bd9-469e-9e0e-8c6f22b6417e" released by "_delete_snapshot" :: held 1.373s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-60695393-29a2-48cb-878b-4d9690a66c8c" released by "delete_snapshot" :: held 1.391s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:57 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Created reservations ['1ec1575b-5c3f-4ac1-a690-581824dbeaac', '17e54de7-4a29-474e-a829-e54cee63ef02', '28ab6a75-c01d-400b-98e3-7513081a95e6', 'ae5bcbda-08af-4d3c-af36-ab9fdccb39a5'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:57 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Delete snapshot completed successfully. Sep 29 16:53:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-59973825-4614-4b03-aa9b-8c24332260c6 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-a13bf139-6bd9-469e-9e0e-8c6f22b6417e-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-60695393-29a2-48cb-878b-4d9690a66c8c-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-60695393-29a2-48cb-878b-4d9690a66c8c-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-60695393-29a2-48cb-878b-4d9690a66c8c" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:53:57 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-60695393-29a2-48cb-878b-4d9690a66c8c" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:53:57 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01f4e5f-19b6-4a54-8746-4d352e725d3b]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:53:57 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:58 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c Sep 29 16:53:58 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:58 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c" returned: 0 in 0.348s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:58 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c Sep 29 16:53:58 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:58 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-60695393-29a2-48cb-878b-4d9690a66c8c" returned: 0 in 0.244s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-60695393-29a2-48cb-878b-4d9690a66c8c" released by "delete_volume" :: held 0.647s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:58 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Created reservations ['8348168e-f4e3-4673-854d-d6e13d5ab45e', '4782de39-b320-48c8-9866-589a591be1fd', 'c07f673b-ccb6-43bf-bf87-8b12aebf8d1d', 'bdc0643f-62fa-45e4-92d9-44831022aa9e'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:53:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:58 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:58 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:53:58 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:58 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:58 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.242s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:58 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:53:58 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Deleted volume successfully. Sep 29 16:53:58 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-c5dab267-4391-435f-9fec-919a916c8f43 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-60695393-29a2-48cb-878b-4d9690a66c8c-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Flow 'volume_create_manager' (5d92051d-676f-4d6e-8051-292f695bcdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ed5814-301f-40fd-803e-583fb16b90ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ed5814-301f-40fd-803e-583fb16b90ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1583217263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a590f421-de6e-40f8-b8d4-9adcb06b68fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6715f8f7e51043ffb62edaeca5dcc368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:59Z,use_quota=True,user_id='0b80f19b01904e71bb038e0fe2190fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce054a4-4f56-4811-bbb6-72ec572f1370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce054a4-4f56-4811-bbb6-72ec572f1370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9afe9f-f742-4bd6-bf5e-080fbaa7b992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c9afe9f-f742-4bd6-bf5e-080fbaa7b992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a590f421-de6e-40f8-b8d4-9adcb06b68fc', 'volume_name': 'volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8efc730-366a-4917-b1b7-c6238cb1b8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8efc730-366a-4917-b1b7-c6238cb1b8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a118bf5-ab13-4001-a13a-6a64f9f108df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:53:59 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Volume a590f421-de6e-40f8-b8d4-9adcb06b68fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc', 'volume_size': 1} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1583217263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a590f421-de6e-40f8-b8d4-9adcb06b68fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6715f8f7e51043ffb62edaeca5dcc368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:53:59Z,use_quota=True,user_id='0b80f19b01904e71bb038e0fe2190fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Creating volume a590f421-de6e-40f8-b8d4-9adcb06b68fc {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:53:59 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:59 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc 1073741824 Sep 29 16:53:59 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:53:59 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc 1073741824" returned: 0 in 0.410s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:53:59 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:53:59 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc Sep 29 16:53:59 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:00 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc" returned: 0 in 0.238s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:54:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:00 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a118bf5-ab13-4001-a13a-6a64f9f108df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:00 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f824ab13-780b-4055-899f-2fe79c9d9b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:00 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Volume volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc (a590f421-de6e-40f8-b8d4-9adcb06b68fc): created successfully Sep 29 16:54:00 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f824ab13-780b-4055-899f-2fe79c9d9b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:00 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Flow 'volume_create_manager' (5d92051d-676f-4d6e-8051-292f695bcdd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:54:00 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-78fd093a-f189-48df-aae8-0825077020ee tempest-ProjectReaderTests-1074617190 None] Created volume successfully. Sep 29 16:54:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:00 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] Creating offline snapshot 5b88446e-1c9f-4d3e-98b9-7717ddb97626 of volume a590f421-de6e-40f8-b8d4-9adcb06b68fc {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:54:00 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30fd311-307f-4cd4-98ff-761c07594744]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:54:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:00 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc Sep 29 16:54:00 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:00 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc" returned: 0 in 0.359s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:00 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:00 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 1G Sep 29 16:54:00 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:01 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 1G" returned: 0 in 0.381s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:01 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 Sep 29 16:54:01 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:01 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626" returned: 0 in 0.288s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:01 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 is being set with open permissions: ugo+rw Sep 29 16:54:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:01 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 Sep 29 16:54:01 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:01 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626" returned: 0 in 0.235s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:01 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:01 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.info Sep 29 16:54:01 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:02 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.info" returned: 0 in 0.250s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:02 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.info is being set with open permissions: ugo+rw Sep 29 16:54:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:02 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.info Sep 29 16:54:02 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:02 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.info" returned: 0 in 0.240s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:02 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-0187e252-a36f-477d-839a-5c94aa25eba3 tempest-ProjectReaderTests-1074617190 None] Create snapshot completed successfully Sep 29 16:54:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-5b88446e-1c9f-4d3e-98b9-7717ddb97626-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-5b88446e-1c9f-4d3e-98b9-7717ddb97626-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-a590f421-de6e-40f8-b8d4-9adcb06b68fc" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-a590f421-de6e-40f8-b8d4-9adcb06b68fc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-5b88446e-1c9f-4d3e-98b9-7717ddb97626" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:02 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-5b88446e-1c9f-4d3e-98b9-7717ddb97626" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Deleting offline snapshot 5b88446e-1c9f-4d3e-98b9-7717ddb97626 of volume a590f421-de6e-40f8-b8d4-9adcb06b68fc {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:54:02 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] snapshot_file for this snap is: volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:54:02 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[f917815e-8adc-4c56-98e6-6cd5df5e6c27]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:54:02 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:02 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 Sep 29 16:54:02 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:03 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626" returned: 0 in 0.350s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:03 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:54:03 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5610ade-f490-4185-ac99-385396a6d244]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:54:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:03 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc Sep 29 16:54:03 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:03 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc" returned: 0 in 0.350s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:03 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 Sep 29 16:54:03 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:03 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626" returned: 0 in 0.321s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:03 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:03 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626 Sep 29 16:54:03 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:04 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc.5b88446e-1c9f-4d3e-98b9-7717ddb97626" returned: 0 in 0.239s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-5b88446e-1c9f-4d3e-98b9-7717ddb97626" released by "_delete_snapshot" :: held 1.349s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-a590f421-de6e-40f8-b8d4-9adcb06b68fc" released by "delete_snapshot" :: held 1.370s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:04 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Created reservations ['a3294971-d5b4-474f-a948-b622a2f335a1', 'ba61403c-3595-4094-b237-3862efebff1d', '4c8f2529-ecc3-44ae-a654-e42f6824eead', '3b8172cc-e424-403e-aaf0-9335fc388c2f'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:54:04 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Delete snapshot completed successfully. Sep 29 16:54:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-23315732-7cad-493e-b64f-dfdf016d6084 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-5b88446e-1c9f-4d3e-98b9-7717ddb97626-delete_snapshot" released by "delete_snapshot" :: held 1.496s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-a590f421-de6e-40f8-b8d4-9adcb06b68fc-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-a590f421-de6e-40f8-b8d4-9adcb06b68fc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-a590f421-de6e-40f8-b8d4-9adcb06b68fc" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:04 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-a590f421-de6e-40f8-b8d4-9adcb06b68fc" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:04 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcc4790-7667-4a03-b1b6-155d508153fa]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:54:04 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:05 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc Sep 29 16:54:05 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:05 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc" returned: 0 in 0.352s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:05 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc Sep 29 16:54:05 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:05 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-a590f421-de6e-40f8-b8d4-9adcb06b68fc" returned: 0 in 0.248s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-a590f421-de6e-40f8-b8d4-9adcb06b68fc" released by "delete_volume" :: held 0.659s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:05 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Created reservations ['e65713ae-122f-4c0a-a00a-701d9fa33d80', 'd0412747-4647-46bd-8701-6152d580b937', '8cba305a-c615-4796-abc1-a1647119485b', '9a8f27e7-8027-4b8c-b015-1d6691ea59db'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:54:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:54:05 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:54:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:05 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:54:05 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:05 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:05 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.245s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:05 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:54:05 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Deleted volume successfully. Sep 29 16:54:05 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-0fb54dd5-4e13-42d5-812f-731b8244fad1 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-a590f421-de6e-40f8-b8d4-9adcb06b68fc-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Flow 'volume_create_manager' (e2f2d86e-fe9f-48dc-93d8-b8726be8f621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20427ab9-ce74-46a2-a0c8-ef60b099b972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20427ab9-ce74-46a2-a0c8-ef60b099b972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1613939178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571cc63c-090f-41e5-9c64-a03cae9bbc84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6715f8f7e51043ffb62edaeca5dcc368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:54:06Z,use_quota=True,user_id='0b80f19b01904e71bb038e0fe2190fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbd83eb-ea41-4443-9ab2-15a964c58784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dbd83eb-ea41-4443-9ab2-15a964c58784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c1aad7-63b4-4f1f-893b-498d4067a270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c1aad7-63b4-4f1f-893b-498d4067a270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '571cc63c-090f-41e5-9c64-a03cae9bbc84', 'volume_name': 'volume-571cc63c-090f-41e5-9c64-a03cae9bbc84', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd62d3df-a34e-48b9-9965-3a083db2cf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd62d3df-a34e-48b9-9965-3a083db2cf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ac6c6c-d952-4a5b-aa56-b79b7630cded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:06 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Volume 571cc63c-090f-41e5-9c64-a03cae9bbc84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-571cc63c-090f-41e5-9c64-a03cae9bbc84', 'volume_size': 1} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1613939178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571cc63c-090f-41e5-9c64-a03cae9bbc84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6715f8f7e51043ffb62edaeca5dcc368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:54:06Z,use_quota=True,user_id='0b80f19b01904e71bb038e0fe2190fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Creating volume 571cc63c-090f-41e5-9c64-a03cae9bbc84 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:54:06 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:06 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 1073741824 Sep 29 16:54:06 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:06 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 1073741824" returned: 0 in 0.398s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:06 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:06 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 Sep 29 16:54:06 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:07 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84" returned: 0 in 0.246s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:54:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ac6c6c-d952-4a5b-aa56-b79b7630cded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571cc63c-090f-41e5-9c64-a03cae9bbc84', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983e75b2-6203-497f-b693-cc25bdc878f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:07 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Volume volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 (571cc63c-090f-41e5-9c64-a03cae9bbc84): created successfully Sep 29 16:54:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983e75b2-6203-497f-b693-cc25bdc878f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:07 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Flow 'volume_create_manager' (e2f2d86e-fe9f-48dc-93d8-b8726be8f621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:54:07 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-7c6e274e-4639-49a4-9e3d-8bf5b61ac4f7 tempest-ProjectReaderTests-1074617190 None] Created volume successfully. Sep 29 16:54:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:07 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] Creating offline snapshot 96f19562-55c5-41ad-8de3-ee25b24da8e4 of volume 571cc63c-090f-41e5-9c64-a03cae9bbc84 {{(pid=86793) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 16:54:07 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf6f9af-6b37-4aa2-b8fe-94f66cfe3266]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:54:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:07 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 Sep 29 16:54:07 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:07 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84" returned: 0 in 0.358s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:07 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 1G {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:07 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 1G Sep 29 16:54:07 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:08 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 1G" returned: 0 in 0.383s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:08 devstack sudo[108775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 Sep 29 16:54:08 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:08 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 -F qcow2 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4" returned: 0 in 0.280s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:08 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 is being set with open permissions: ugo+rw Sep 29 16:54:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:08 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 Sep 29 16:54:08 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:08 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4" returned: 0 in 0.258s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:08 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:08 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.info Sep 29 16:54:08 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:09 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.info" returned: 0 in 0.242s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:09 devstack cinder-volume[86793]: WARNING cinder.volume.drivers.remotefs [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.info is being set with open permissions: ugo+rw Sep 29 16:54:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.info {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:09 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.info Sep 29 16:54:09 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:09 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.info" returned: 0 in 0.241s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.841s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:09 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-be72bbb4-71d3-403c-ac6b-cc4197269bb7 tempest-ProjectReaderTests-1074617190 None] Create snapshot completed successfully Sep 29 16:54:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-96f19562-55c5-41ad-8de3-ee25b24da8e4-delete_snapshot" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-96f19562-55c5-41ad-8de3-ee25b24da8e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-571cc63c-090f-41e5-9c64-a03cae9bbc84" by "delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-571cc63c-090f-41e5-9c64-a03cae9bbc84" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-96f19562-55c5-41ad-8de3-ee25b24da8e4" by "_delete_snapshot" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:09 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-96f19562-55c5-41ad-8de3-ee25b24da8e4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:09 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Deleting offline snapshot 96f19562-55c5-41ad-8de3-ee25b24da8e4 of volume 571cc63c-090f-41e5-9c64-a03cae9bbc84 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 16:54:09 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] snapshot_file for this snap is: volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 {{(pid=86793) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 16:54:09 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc0520c-6c97-4def-bb87-550d9cbd6f26]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:54:09 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:09 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 Sep 29 16:54:09 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:10 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4" returned: 0 in 0.348s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:10 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-571cc63c-090f-41e5-9c64-a03cae9bbc84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86793) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 16:54:10 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[7294e928-9840-4752-a6a0-1ef6c1be1b46]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:54:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:10 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 Sep 29 16:54:10 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:10 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84" returned: 0 in 0.357s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:10 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 Sep 29 16:54:10 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:10 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4" returned: 0 in 0.331s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:10 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:10 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4 Sep 29 16:54:10 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:11 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84.96f19562-55c5-41ad-8de3-ee25b24da8e4" returned: 0 in 0.245s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-96f19562-55c5-41ad-8de3-ee25b24da8e4" released by "_delete_snapshot" :: held 1.370s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-571cc63c-090f-41e5-9c64-a03cae9bbc84" released by "delete_snapshot" :: held 1.397s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:11 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Created reservations ['4cd10c58-c269-44e9-8f17-8d7bbd7040d1', 'eb21a7c5-f58c-4287-ad5a-6a7b08b61e06', 'd8343a12-6962-4073-8380-e75bd171f1b5', '90884824-ecaa-4902-b6a5-d67482f748a0'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:54:11 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Delete snapshot completed successfully. Sep 29 16:54:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-f5f40c38-3fdd-4bac-be55-03ae80837239 tempest-ProjectReaderTests-1074617190 None] Lock "cinder-96f19562-55c5-41ad-8de3-ee25b24da8e4-delete_snapshot" released by "delete_snapshot" :: held 1.523s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-571cc63c-090f-41e5-9c64-a03cae9bbc84-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Lock "cinder-571cc63c-090f-41e5-9c64-a03cae9bbc84-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Acquiring lock "cinder-quobyte-571cc63c-090f-41e5-9c64-a03cae9bbc84" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:11 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-571cc63c-090f-41e5-9c64-a03cae9bbc84" acquired by "delete_volume" :: waited 0.015s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:11 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b760ce-f966-48a6-9614-fbbe8e15ef0c]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:54:11 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:12 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 Sep 29 16:54:12 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:12 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84" returned: 0 in 0.350s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:12 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84 Sep 29 16:54:12 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:12 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-571cc63c-090f-41e5-9c64-a03cae9bbc84" returned: 0 in 0.243s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Lock "cinder-quobyte-571cc63c-090f-41e5-9c64-a03cae9bbc84" released by "delete_volume" :: held 0.648s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:12 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Created reservations ['8a30c298-d1d4-4d31-a3e4-8719fd716784', '95bd4283-c973-44ee-be68-21436aeacea5', '1bb780b6-fb2d-4d8f-a4d6-0596bdb5ea06', 'd9eb2917-f3a0-4afc-8b72-287d7b3c5b2a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:54:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:54:12 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:54:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:12 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:54:12 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:12 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:12 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.242s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:12 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:54:12 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Deleted volume successfully. Sep 29 16:54:12 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-33dbd509-0d96-4593-8ed4-b38332c1b45f tempest-ProjectReaderTests-1074617190 None] Lock "cinder-571cc63c-090f-41e5-9c64-a03cae9bbc84-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:INSERT=35,cinder:UPDATE=137,cinder:SELECT=107,cinder:DELETE=15 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=108,cinder:INSERT=43,cinder:UPDATE=144,cinder:DELETE=7 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Flow 'volume_create_manager' (1bb4e9b6-eeec-4cba-ab61-2215304e1e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bd9084-2c23-4cfa-b10d-bb4f21dddc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bd9084-2c23-4cfa-b10d-bb4f21dddc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1393711145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b185e8-02a3-4ed2-9b99-c506ed158ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71977b0c2d3b489d8a7ef25238cfbb1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:54:25Z,use_quota=True,user_id='9f083b35d04c4e4eb5e16f87b67a0e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7393d011-63af-4edc-8cc9-aaa5b0a622a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7393d011-63af-4edc-8cc9-aaa5b0a622a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0d18f2-fbd6-4275-ab1f-4de990f6e5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd0d18f2-fbd6-4275-ab1f-4de990f6e5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b185e8-02a3-4ed2-9b99-c506ed158ef5', 'volume_name': 'volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5187a1fd-9d5d-4a24-ae70-d0994de06f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5187a1fd-9d5d-4a24-ae70-d0994de06f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a96b10d-6bcf-4b7a-9ccf-f8369fa7f4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:24 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Volume b0b185e8-02a3-4ed2-9b99-c506ed158ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5', 'volume_size': 1} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1393711145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b185e8-02a3-4ed2-9b99-c506ed158ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71977b0c2d3b489d8a7ef25238cfbb1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:54:25Z,use_quota=True,user_id='9f083b35d04c4e4eb5e16f87b67a0e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Creating volume b0b185e8-02a3-4ed2-9b99-c506ed158ef5 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:54:24 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:54:24 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:24 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5 1073741824 Sep 29 16:54:24 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:25 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5 1073741824" returned: 0 in 0.396s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:25 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5 Sep 29 16:54:25 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:25 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5" returned: 0 in 0.247s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a96b10d-6bcf-4b7a-9ccf-f8369fa7f4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15dab2c1-1814-4983-8f17-0573d456db0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:25 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Volume volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5 (b0b185e8-02a3-4ed2-9b99-c506ed158ef5): created successfully Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15dab2c1-1814-4983-8f17-0573d456db0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Flow 'volume_create_manager' (1bb4e9b6-eeec-4cba-ab61-2215304e1e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:54:25 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-da99f217-981b-487d-81ad-6bf274040101 tempest-ProjectReaderTests-102848450 None] Created volume successfully. Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Acquiring lock "cinder-b0b185e8-02a3-4ed2-9b99-c506ed158ef5-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Lock "cinder-b0b185e8-02a3-4ed2-9b99-c506ed158ef5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Acquiring lock "cinder-quobyte-b0b185e8-02a3-4ed2-9b99-c506ed158ef5" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Lock "cinder-quobyte-b0b185e8-02a3-4ed2-9b99-c506ed158ef5" acquired by "delete_volume" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fed2a18-c001-4492-b97b-bd64ff3a1154]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:54:25 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:25 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5 Sep 29 16:54:25 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:26 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5" returned: 0 in 0.350s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:26 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5 Sep 29 16:54:26 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:26 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-b0b185e8-02a3-4ed2-9b99-c506ed158ef5" returned: 0 in 0.242s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Lock "cinder-quobyte-b0b185e8-02a3-4ed2-9b99-c506ed158ef5" released by "delete_volume" :: held 0.630s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:26 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Created reservations ['bc3c2947-ff4a-4d43-9e94-bbc5fa3e0597', 'bf6e3b4b-7827-489f-9d07-66c31b3f017e', 'b486c0c8-1c1f-40ff-b4a2-b545c392fc46', '6d2420c2-5ad8-4ac5-b289-73f2c2e6605a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:54:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:54:26 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:54:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:26 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:54:26 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:26 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:26 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.237s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:26 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:54:26 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Deleted volume successfully. Sep 29 16:54:26 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-6be009bd-1f9b-45cf-bdf2-91eb5322d363 tempest-ProjectReaderTests-102848450 None] Lock "cinder-b0b185e8-02a3-4ed2-9b99-c506ed158ef5-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Flow 'volume_create_manager' (55c5ab58-90fc-46d4-9727-8cc06a61d9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258606f0-8fc9-42de-ab86-24cec45b71db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258606f0-8fc9-42de-ab86-24cec45b71db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1531128440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399c90db-2258-4ca5-b26e-84287cf1511e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71977b0c2d3b489d8a7ef25238cfbb1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:54:27Z,use_quota=True,user_id='9f083b35d04c4e4eb5e16f87b67a0e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693d966a-cd5b-45c1-aca9-ff035d515d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693d966a-cd5b-45c1-aca9-ff035d515d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2211f969-b6fe-44c4-b1e8-e75f6b5047af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2211f969-b6fe-44c4-b1e8-e75f6b5047af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '399c90db-2258-4ca5-b26e-84287cf1511e', 'volume_name': 'volume-399c90db-2258-4ca5-b26e-84287cf1511e', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf70bf1-ed13-456a-9924-e2a6c5fa846c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcf70bf1-ed13-456a-9924-e2a6c5fa846c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555ed387-38af-4e7e-b1fb-dea03e048ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:27 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Volume 399c90db-2258-4ca5-b26e-84287cf1511e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-399c90db-2258-4ca5-b26e-84287cf1511e', 'volume_size': 1} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1531128440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399c90db-2258-4ca5-b26e-84287cf1511e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71977b0c2d3b489d8a7ef25238cfbb1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:54:27Z,use_quota=True,user_id='9f083b35d04c4e4eb5e16f87b67a0e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Creating volume 399c90db-2258-4ca5-b26e-84287cf1511e {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:54:27 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-399c90db-2258-4ca5-b26e-84287cf1511e 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:27 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-399c90db-2258-4ca5-b26e-84287cf1511e 1073741824 Sep 29 16:54:27 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:27 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-399c90db-2258-4ca5-b26e-84287cf1511e 1073741824" returned: 0 in 0.395s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:27 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-399c90db-2258-4ca5-b26e-84287cf1511e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:27 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-399c90db-2258-4ca5-b26e-84287cf1511e Sep 29 16:54:27 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:28 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-399c90db-2258-4ca5-b26e-84287cf1511e" returned: 0 in 0.248s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555ed387-38af-4e7e-b1fb-dea03e048ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-399c90db-2258-4ca5-b26e-84287cf1511e', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58461a3e-6176-42ed-86f4-28bf6713c9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:28 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Volume volume-399c90db-2258-4ca5-b26e-84287cf1511e (399c90db-2258-4ca5-b26e-84287cf1511e): created successfully Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58461a3e-6176-42ed-86f4-28bf6713c9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Flow 'volume_create_manager' (55c5ab58-90fc-46d4-9727-8cc06a61d9a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:54:28 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-b4edc917-1cf9-441a-8ec1-d3f504cc3cae tempest-ProjectReaderTests-102848450 None] Created volume successfully. Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Acquiring lock "cinder-399c90db-2258-4ca5-b26e-84287cf1511e-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Lock "cinder-399c90db-2258-4ca5-b26e-84287cf1511e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Acquiring lock "cinder-quobyte-399c90db-2258-4ca5-b26e-84287cf1511e" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Lock "cinder-quobyte-399c90db-2258-4ca5-b26e-84287cf1511e" acquired by "delete_volume" :: waited 0.013s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd8cbfe-0698-4a77-af14-5858dc0cc6a2]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-399c90db-2258-4ca5-b26e-84287cf1511e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:28 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-399c90db-2258-4ca5-b26e-84287cf1511e Sep 29 16:54:28 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:28 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-399c90db-2258-4ca5-b26e-84287cf1511e" returned: 0 in 0.362s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:28 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-399c90db-2258-4ca5-b26e-84287cf1511e {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:28 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-399c90db-2258-4ca5-b26e-84287cf1511e Sep 29 16:54:28 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:29 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-399c90db-2258-4ca5-b26e-84287cf1511e" returned: 0 in 0.239s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Lock "cinder-quobyte-399c90db-2258-4ca5-b26e-84287cf1511e" released by "delete_volume" :: held 0.642s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Created reservations ['ed35bdee-579e-45bf-b441-b2353b85d32c', 'd935c03c-ae72-4699-a4bf-e5e1e580d570', '25db1eb0-1ee8-4967-8433-118c4f017d5a', 'df732fcc-0939-4e27-930d-5e85cdb5e211'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:29 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:54:29 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:29 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.250s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:54:29 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Deleted volume successfully. Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-03e8eef0-9a34-403f-bc58-a9edb45b2282 tempest-ProjectReaderTests-102848450 None] Lock "cinder-399c90db-2258-4ca5-b26e-84287cf1511e-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Flow 'volume_create_manager' (d62a9503-6155-4cf6-a892-0bf0c70f2a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:54:29 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8d0e5c-1b4a-4458-aac1-65ac97086f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8d0e5c-1b4a-4458-aac1-65ac97086f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1427613412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d096568c-72e9-4197-9982-fc27ef9f9303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71977b0c2d3b489d8a7ef25238cfbb1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:54:30Z,use_quota=True,user_id='9f083b35d04c4e4eb5e16f87b67a0e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f956e248-90a1-4e57-8809-3409e52a53d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f956e248-90a1-4e57-8809-3409e52a53d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7514528-1218-48f8-ba3b-11fa67c8c879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7514528-1218-48f8-ba3b-11fa67c8c879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd096568c-72e9-4197-9982-fc27ef9f9303', 'volume_name': 'volume-d096568c-72e9-4197-9982-fc27ef9f9303', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ee56dc-19d7-4809-bae2-81590379414d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ee56dc-19d7-4809-bae2-81590379414d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9346d94f-2280-43af-8677-ca2349c1417b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:30 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Volume d096568c-72e9-4197-9982-fc27ef9f9303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d096568c-72e9-4197-9982-fc27ef9f9303', 'volume_size': 1} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1427613412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d096568c-72e9-4197-9982-fc27ef9f9303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71977b0c2d3b489d8a7ef25238cfbb1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:54:30Z,use_quota=True,user_id='9f083b35d04c4e4eb5e16f87b67a0e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Creating volume d096568c-72e9-4197-9982-fc27ef9f9303 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:54:30 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d096568c-72e9-4197-9982-fc27ef9f9303 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:30 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d096568c-72e9-4197-9982-fc27ef9f9303 1073741824 Sep 29 16:54:30 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:30 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d096568c-72e9-4197-9982-fc27ef9f9303 1073741824" returned: 0 in 0.405s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d096568c-72e9-4197-9982-fc27ef9f9303 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:30 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d096568c-72e9-4197-9982-fc27ef9f9303 Sep 29 16:54:30 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:30 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d096568c-72e9-4197-9982-fc27ef9f9303" returned: 0 in 0.242s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9346d94f-2280-43af-8677-ca2349c1417b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d096568c-72e9-4197-9982-fc27ef9f9303', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4ac2dc-9aa2-4a7b-a38a-00877d1b0c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:30 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Volume volume-d096568c-72e9-4197-9982-fc27ef9f9303 (d096568c-72e9-4197-9982-fc27ef9f9303): created successfully Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4ac2dc-9aa2-4a7b-a38a-00877d1b0c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:30 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Flow 'volume_create_manager' (d62a9503-6155-4cf6-a892-0bf0c70f2a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:54:30 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-82dc29aa-1d09-4186-b35b-9e715e72a8bf tempest-ProjectReaderTests-102848450 None] Created volume successfully. Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Acquiring lock "cinder-d096568c-72e9-4197-9982-fc27ef9f9303-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Lock "cinder-d096568c-72e9-4197-9982-fc27ef9f9303-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Acquiring lock "cinder-quobyte-d096568c-72e9-4197-9982-fc27ef9f9303" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Lock "cinder-quobyte-d096568c-72e9-4197-9982-fc27ef9f9303" acquired by "delete_volume" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52a3f24-2c8b-4b37-b5ea-734b30abf0b9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d096568c-72e9-4197-9982-fc27ef9f9303 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:31 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d096568c-72e9-4197-9982-fc27ef9f9303 Sep 29 16:54:31 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:31 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d096568c-72e9-4197-9982-fc27ef9f9303" returned: 0 in 0.364s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d096568c-72e9-4197-9982-fc27ef9f9303 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:31 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d096568c-72e9-4197-9982-fc27ef9f9303 Sep 29 16:54:31 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:31 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-d096568c-72e9-4197-9982-fc27ef9f9303" returned: 0 in 0.239s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Lock "cinder-quobyte-d096568c-72e9-4197-9982-fc27ef9f9303" released by "delete_volume" :: held 0.643s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Created reservations ['f3681a62-a695-4e50-ae6e-a9ae5f3fc80a', 'b4fe6c9b-e0a6-4338-bafb-973f90500685', '5d494a46-5686-40c4-af69-926b9e741e16', '63869426-217a-4056-8dea-d01dbae1084a'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:31 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:31 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:54:31 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:32 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.266s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:54:32 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Deleted volume successfully. Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-e5941088-e532-4a54-8539-835f6a35994a tempest-ProjectReaderTests-102848450 None] Lock "cinder-d096568c-72e9-4197-9982-fc27ef9f9303-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86793) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Flow 'volume_create_manager' (80d71bca-a830-4e8e-8ce8-2d46397ad330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0cf78eb-481c-4d80-893e-81bcae0391a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0cf78eb-481c-4d80-893e-81bcae0391a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1233712023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93bae82-80be-4318-9392-f8e87d3c4713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71977b0c2d3b489d8a7ef25238cfbb1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:54:33Z,use_quota=True,user_id='9f083b35d04c4e4eb5e16f87b67a0e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846027c5-66f9-44ef-b12c-3bb0b3b9b8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846027c5-66f9-44ef-b12c-3bb0b3b9b8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95877f02-7a0a-4ad8-ba22-5c0e68c2506f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95877f02-7a0a-4ad8-ba22-5c0e68c2506f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e93bae82-80be-4318-9392-f8e87d3c4713', 'volume_name': 'volume-e93bae82-80be-4318-9392-f8e87d3c4713', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b90ce72-52d5-4559-8f5e-012902e925b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b90ce72-52d5-4559-8f5e-012902e925b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261dc0db-403c-4bd9-8a4a-285d2d0a0d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:32 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Volume e93bae82-80be-4318-9392-f8e87d3c4713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e93bae82-80be-4318-9392-f8e87d3c4713', 'volume_size': 1} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T14:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1233712023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93bae82-80be-4318-9392-f8e87d3c4713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71977b0c2d3b489d8a7ef25238cfbb1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T14:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T14:54:33Z,use_quota=True,user_id='9f083b35d04c4e4eb5e16f87b67a0e9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(256487db-bba1-4618-9f75-7d38a8564d80),volume_type_id=256487db-bba1-4618-9f75-7d38a8564d80)}" {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.remotefs [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Creating volume e93bae82-80be-4318-9392-f8e87d3c4713 {{(pid=86793) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Selected osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb as target Quobyte volume. {{(pid=86793) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 16:54:32 devstack cinder-volume[86793]: INFO cinder.volume.drivers.remotefs [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] casted to osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb Sep 29 16:54:32 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e93bae82-80be-4318-9392-f8e87d3c4713 1073741824 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:32 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e93bae82-80be-4318-9392-f8e87d3c4713 1073741824 Sep 29 16:54:32 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:33 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e93bae82-80be-4318-9392-f8e87d3c4713 1073741824" returned: 0 in 0.409s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e93bae82-80be-4318-9392-f8e87d3c4713 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:33 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e93bae82-80be-4318-9392-f8e87d3c4713 Sep 29 16:54:33 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:33 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e93bae82-80be-4318-9392-f8e87d3c4713" returned: 0 in 0.243s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'} {{(pid=86793) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261dc0db-403c-4bd9-8a4a-285d2d0a0d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93bae82-80be-4318-9392-f8e87d3c4713', 'volume_size': 1}' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbdf321-b956-423b-b41b-6c132e41c596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 16:54:33 devstack cinder-volume[86793]: INFO cinder.volume.flows.manager.create_volume [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Volume volume-e93bae82-80be-4318-9392-f8e87d3c4713 (e93bae82-80be-4318-9392-f8e87d3c4713): created successfully Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbdf321-b956-423b-b41b-6c132e41c596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86793) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Flow 'volume_create_manager' (80d71bca-a830-4e8e-8ce8-2d46397ad330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86793) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 16:54:33 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-9c5b44bd-eebe-45af-b7ec-c46d9fd9bd81 tempest-ProjectReaderTests-102848450 None] Created volume successfully. Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Acquiring lock "cinder-e93bae82-80be-4318-9392-f8e87d3c4713-delete_volume" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Lock "cinder-e93bae82-80be-4318-9392-f8e87d3c4713-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Acquiring lock "cinder-quobyte-e93bae82-80be-4318-9392-f8e87d3c4713" by "delete_volume" {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Lock "cinder-quobyte-e93bae82-80be-4318-9392-f8e87d3c4713" acquired by "delete_volume" :: waited 0.014s {{(pid=86793) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e2894d-0022-4a4e-80d7-2c63323f93a9]: (4, 'qcow2') {{(pid=87677) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 16:54:33 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e93bae82-80be-4318-9392-f8e87d3c4713 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:33 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e93bae82-80be-4318-9392-f8e87d3c4713 Sep 29 16:54:33 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:34 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e93bae82-80be-4318-9392-f8e87d3c4713" returned: 0 in 0.359s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e93bae82-80be-4318-9392-f8e87d3c4713 {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:34 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e93bae82-80be-4318-9392-f8e87d3c4713 Sep 29 16:54:34 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:34 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba/volume-e93bae82-80be-4318-9392-f8e87d3c4713" returned: 0 in 0.240s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Lock "cinder-quobyte-e93bae82-80be-4318-9392-f8e87d3c4713" released by "delete_volume" :: held 0.638s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG cinder.quota [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Created reservations ['32176816-eacf-4bec-a30e-08694b97a13f', '3a99caaa-1dbd-4681-9cba-3a7a9f3b0b65', 'e06cd2a7-ea94-4caa-81d7-45d30ff7342c', '6c8c1017-9755-4598-9fce-79697edaae8e'] {{(pid=86793) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:34 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:54:34 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:34 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.233s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:54:34 devstack cinder-volume[86793]: INFO cinder.volume.manager [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Deleted volume successfully. Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG cinder.coordination [None req-eea05bf7-b5c5-431f-b4be-8271d994462a tempest-ProjectReaderTests-102848450 None] Lock "cinder-e93bae82-80be-4318-9392-f8e87d3c4713-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=86793) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb': None} {{(pid=86793) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG cinder.volume.drivers.quobyte [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1b7dfbac-cfac-469a-9c81-4323536362fb'] {{(pid=86793) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.lockutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86793) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 16:54:34 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 16:54:34 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba Sep 29 16:54:34 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 16:54:35 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Sep 29 16:54:35 devstack cinder-volume[86793]: DEBUG oslo_concurrency.processutils [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/304f4c088761422dcce914d4dc58e4ba" returned: 0 in 0.265s {{(pid=86793) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 16:54:35 devstack cinder-volume[86793]: DEBUG cinder.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Notifying Schedulers of capabilities ... {{(pid=86793) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 16:54:35 devstack cinder-volume[86793]: DEBUG oslo_service.periodic_task [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] Running periodic task VolumeManager._thread_info {{(pid=86793) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 16:54:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread count: 29 {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 16:54:35 devstack cinder-volume[86793]: DEBUG cinder.volume.manager [None req-7718540b-fa06-42a3-8487-b26b04fc8db2 None None] thread info: [<_MainThread(MainThread, started 132648405454976)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86793) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 16:54:44 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=29,cinder:UPDATE=38,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 16:54:44 devstack cinder-volume[86793]: DEBUG dbcounter [-] [86793] Writing DB stats cinder:SELECT=26,cinder:UPDATE=49,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86793) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}